tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.P4sNoA3I8A', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) (finished: start all VMs, in 59.98 seconds) gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for unit setup-gitlab.service gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab: waiting for the VM to finish booting gitlab # Filesystem UUID: 16a95321-c36f-4b0e-8842-5ac76363770a gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)... gitlab # gitlab # gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)... gitlab # gitlab # gitlab # Booting from ROM... gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pjxpj4wzxavf7p9xvm6ciy6ix5c8rs57-nixos-system-gitlab-test/init regInfo=/nix/store/sgkf3nwylasnpzkqz1fizg3py1k3916g-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.000000] BIOS-provided physical RAM map: gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved gitlab # [ 0.000000] NX (Execute Disable) protection: active gitlab # [ 0.000000] APIC: Static calls initialized gitlab # [ 0.000000] SMBIOS 2.8 present. gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 gitlab # [ 0.000000] DMI: Memory slots populated: 1/1 gitlab # [ 0.000000] Hypervisor detected: KVM gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 gitlab # [ 0.000001] kvm-clock: using sched offset of 473995363 cycles gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor gitlab # [ 0.000809] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000 gitlab # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs gitlab # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT gitlab # [ 0.000877] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.002738] found SMP MP-table at [mem 0x000f5470-0x000f547f] gitlab # [ 0.002750] Using GB pages for direct mapping gitlab # [ 0.002856] RAMDISK: [mem 0xbe31c000-0xbffcffff] gitlab # [ 0.002863] ACPI: Early table checksum verification disabled gitlab # [ 0.002866] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) gitlab # [ 0.002870] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002874] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002881] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002883] ACPI: FACS 0x00000000BFFE0000 000040 gitlab # [ 0.002884] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002886] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002888] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002889] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2] gitlab # [ 0.002890] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e] gitlab # [ 0.002890] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] gitlab # [ 0.002891] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482] gitlab # [ 0.002891] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba] gitlab # [ 0.002892] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2] gitlab # [ 0.003113] No NUMA configuration found gitlab # [ 0.003114] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff] gitlab # [ 0.003117] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff] gitlab # [ 0.005793] Zone ranges: gitlab # [ 0.005794] DMA [mem 0x0000000000001000-0x0000000000ffffff] gitlab # [ 0.005796] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] gitlab # [ 0.005797] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005798] Device empty gitlab # [ 0.005799] Movable zone start for each node gitlab # [ 0.005800] Early memory node ranges gitlab # [ 0.005800] node 0: [mem 0x0000000000001000-0x000000000009efff] gitlab # [ 0.005801] node 0: [mem 0x0000000000100000-0x00000000bffd7fff] gitlab # [ 0.005802] node 0: [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005804] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff] gitlab # [ 0.005824] On node 0, zone DMA: 1 pages in unavailable ranges gitlab # [ 0.006100] On node 0, zone DMA: 97 pages in unavailable ranges gitlab # [ 0.117754] On node 0, zone Normal: 40 pages in unavailable ranges gitlab # [ 0.118186] ACPI: PM-Timer IO Port: 0x608 gitlab # [ 0.118202] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) gitlab # [ 0.118240] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 gitlab # [ 0.118243] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) gitlab # [ 0.118245] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) gitlab # [ 0.118246] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) gitlab # [ 0.118247] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) gitlab # [ 0.118248] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) gitlab # [ 0.118250] ACPI: Using ACPI (MADT) for SMP configuration information gitlab # [ 0.118252] ACPI: HPET id: 0x8086a201 base: 0xfed00000 gitlab # [ 0.118257] TSC deadline timer available gitlab # [ 0.118262] CPU topo: Max. logical packages: 1 gitlab # [ 0.118263] CPU topo: Max. logical dies: 1 gitlab # [ 0.118263] CPU topo: Max. dies per package: 1 gitlab # [ 0.118267] CPU topo: Max. threads per core: 1 gitlab # [ 0.118268] CPU topo: Num. cores per package: 4 gitlab # [ 0.118268] CPU topo: Num. threads per package: 4 gitlab # [ 0.118269] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs gitlab # [ 0.118295] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() gitlab # [ 0.118314] kvm-guest: KVM setup pv remote TLB flush gitlab # [ 0.118316] kvm-guest: setup PV sched yield gitlab # [ 0.118333] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] gitlab # [ 0.118334] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] gitlab # [ 0.118335] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff] gitlab # [ 0.118337] [mem 0xc0000000-0xfeffbfff] available for PCI devices gitlab # [ 0.118339] Booting paravirtualized kernel on KVM gitlab # [ 0.118343] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns gitlab # [ 0.122809] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 gitlab # [ 0.125121] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 gitlab # [ 0.125176] kvm-guest: PV spinlocks enabled gitlab # [ 0.125178] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) gitlab # [ 0.125181] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pjxpj4wzxavf7p9xvm6ciy6ix5c8rs57-nixos-system-gitlab-test/init regInfo=/nix/store/sgkf3nwylasnpzkqz1fizg3py1k3916g-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.125282] Unknown kernel command line parameters "regInfo=/nix/store/sgkf3nwylasnpzkqz1fizg3py1k3916g-closure-info/registration", will be passed to user space. gitlab # [ 0.125295] random: crng init done gitlab # [ 0.125296] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes gitlab # [ 0.134470] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.139171] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.139263] software IO TLB: area num 4. gitlab # [ 0.217183] Fallback order for Node 0: 0 gitlab # [ 0.217192] Built 1 zonelists, mobility grouping on. Total pages: 1572726 gitlab # [ 0.217194] Policy zone: Normal gitlab # [ 0.219818] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.230257] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.244776] allocated 12582912 bytes of page_ext gitlab # [ 0.255143] ftrace: allocating 48717 entries in 192 pages gitlab # [ 0.255146] ftrace: allocated 192 pages with 2 groups gitlab # [ 0.256050] Dynamic Preempt: lazy gitlab # [ 0.256210] rcu: Preemptible hierarchical RCU implementation. gitlab # [ 0.256211] rcu: RCU event tracing is enabled. gitlab # [ 0.256212] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.256213] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.256214] Rude variant of Tasks RCU enabled. gitlab # [ 0.256214] Tracing variant of Tasks RCU enabled. gitlab # [ 0.256215] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. gitlab # [ 0.256216] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.256238] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.256240] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.256241] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.260698] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 gitlab # [ 0.261041] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.261051] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns gitlab # [ 0.261169] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.264836] Console: colour VGA+ 80x25 gitlab # [ 0.264839] printk: legacy console [tty0] enabled gitlab # [ 0.295206] printk: legacy console [ttyS0] enabled gitlab # [ 0.403930] ACPI: Core revision 20250807 gitlab # [ 0.404914] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns gitlab # [ 0.406527] APIC: Switch to symmetric I/O mode setup gitlab # [ 0.407538] x2apic enabled gitlab # [ 0.408314] APIC: Switched APIC routing to: physical x2apic gitlab # [ 0.409303] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() gitlab # [ 0.410581] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() gitlab # [ 0.412106] kvm-guest: setup PV IPIs gitlab # [ 0.413710] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 gitlab # [ 0.414799] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns gitlab # [ 0.416643] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) gitlab # [ 0.417730] x86/cpu: User Mode Instruction Prevention (UMIP) activated gitlab # [ 0.418776] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 gitlab # [ 0.420640] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 gitlab # [ 0.421645] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto gitlab # [ 0.423641] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl gitlab # [ 0.424641] Transient Scheduler Attacks: Vulnerable: No microcode gitlab # [ 0.426640] Spectre V2 : Mitigation: Enhanced / Automatic IBRS gitlab # [ 0.427640] Speculative Return Stack Overflow: Mitigation: Safe RET gitlab # [ 0.428641] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization gitlab # [ 0.429649] Spectre V2 : Enabling IBPB for BPF gitlab # [ 0.430641] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier gitlab # [ 0.431641] active return thunk: srso_alias_return_thunk gitlab # [ 0.433357] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' gitlab # [ 0.434640] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' gitlab # [ 0.435641] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' gitlab # [ 0.436640] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' gitlab # [ 0.437640] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' gitlab # [ 0.438640] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' gitlab # [ 0.439640] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' gitlab # [ 0.441639] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 gitlab # [ 0.442641] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 gitlab # [ 0.443640] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 gitlab # [ 0.444641] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 gitlab # [ 0.445641] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 gitlab # [ 0.446640] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. gitlab # [ 0.476918] Freeing SMP alternatives memory: 44K gitlab # [ 0.477644] pid_max: default: 32768 minimum: 301 gitlab # [ 0.478746] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.479762] landlock: Up and running. gitlab # [ 0.480410] Yama: becoming mindful. gitlab # [ 0.481310] LSM support for eBPF active gitlab # [ 0.482399] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.483796] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.486598] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) gitlab # [ 0.487195] Performance Events: Fam17h+ core perfctr, AMD PMU driver. gitlab # [ 0.487645] ... version: 2 gitlab # [ 0.488394] ... bit width: 48 gitlab # [ 0.488643] ... generic counters: 6 gitlab # [ 0.489422] ... generic bitmap: 000000000000003f gitlab # [ 0.489694] ... fixed-purpose counters: 0 gitlab # [ 0.490490] ... fixed-purpose bitmap: 0000000000000000 gitlab # [ 0.491416] ... value mask: 0000ffffffffffff gitlab # [ 0.491643] ... max period: 00007fffffffffff gitlab # [ 0.492607] ... global_ctrl mask: 000000000000003f gitlab # [ 0.493531] signal: max sigframe size: 3376 gitlab # [ 0.494302] rcu: Hierarchical SRCU implementation. gitlab # [ 0.494647] rcu: Max phase no-delay instances is 400. gitlab # [ 0.495738] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.501354] smp: Bringing up secondary CPUs ... gitlab # [ 0.502059] smpboot: x86: Booting SMP configuration: gitlab # [ 0.502651] .... node #0, CPUs: #1 #2 #3 gitlab # [ 0.505796] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.507644] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) gitlab # [ 0.509003] Memory: 6011580K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260116K reserved, 0K cma-reserved) gitlab # [ 0.511643] devtmpfs: initialized gitlab # [ 0.512799] x86/mm: Memory block size: 128MB gitlab # [ 0.515838] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.517722] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.518755] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.519898] PM: RTC time: 07:08:41, date: 2026-09-08 gitlab # [ 0.524140] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.526077] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.526709] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.528851] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.529656] audit: initializing netlink subsys (disabled) gitlab # [ 0.530669] audit: type=2000 audit(1788851321.596:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.530879] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.532643] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.533643] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.534643] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.535642] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.536671] cpuidle: using governor menu gitlab # [ 0.538891] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 gitlab # [ 0.539881] PCI: Using configuration type 1 for base access gitlab # [ 0.540645] PCI: Using configuration type 1 for extended access gitlab # [ 0.541800] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. gitlab # [ 0.544763] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.547653] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.549649] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.552648] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.559311] ACPI: Added _OSI(Module Device) gitlab # [ 0.559646] ACPI: Added _OSI(Processor Device) gitlab # [ 0.560453] ACPI: Added _OSI(Processor Aggregator Device) gitlab # [ 0.563278] ACPI: 1 ACPI AML tables successfully acquired and loaded gitlab # [ 0.566784] ACPI: Interpreter enabled gitlab # [ 0.568758] ACPI: PM: (supports S0 S3 S4 S5) gitlab # [ 0.570651] ACPI: Using IOAPIC for interrupt routing gitlab # [ 0.572727] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug gitlab # [ 0.576658] PCI: Using E820 reservations for host bridge windows gitlab # [ 0.578994] ACPI: Enabled 2 GPEs in block 00 to 0F gitlab # [ 0.592992] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) gitlab # [ 0.594663] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] gitlab # [ 0.599569] acpiphp: Slot [3] registered gitlab # [ 0.601700] acpiphp: Slot [4] registered gitlab # [ 0.603718] acpiphp: Slot [5] registered gitlab # [ 0.604700] acpiphp: Slot [6] registered gitlab # [ 0.606687] acpiphp: Slot [7] registered gitlab # [ 0.607723] acpiphp: Slot [8] registered gitlab # [ 0.609688] acpiphp: Slot [9] registered gitlab # [ 0.610686] acpiphp: Slot [10] registered gitlab # [ 0.612686] acpiphp: Slot [11] registered gitlab # [ 0.613704] acpiphp: Slot [12] registered gitlab # [ 0.614688] acpiphp: Slot [13] registered gitlab # [ 0.616685] acpiphp: Slot [14] registered gitlab # [ 0.617683] acpiphp: Slot [15] registered gitlab # [ 0.619702] acpiphp: Slot [16] registered gitlab # [ 0.620686] acpiphp: Slot [17] registered gitlab # [ 0.622685] acpiphp: Slot [18] registered gitlab # [ 0.623685] acpiphp: Slot [19] registered gitlab # [ 0.624701] acpiphp: Slot [20] registered gitlab # [ 0.625478] acpiphp: Slot [21] registered gitlab # [ 0.626222] acpiphp: Slot [22] registered gitlab # [ 0.627684] acpiphp: Slot [23] registered gitlab # [ 0.628412] acpiphp: Slot [24] registered gitlab # [ 0.628662] acpiphp: Slot [25] registered gitlab # [ 0.629416] acpiphp: Slot [26] registered gitlab # [ 0.630756] acpiphp: Slot [27] registered gitlab # [ 0.631817] acpiphp: Slot [28] registered gitlab # [ 0.632574] acpiphp: Slot [29] registered gitlab # [ 0.633193] acpiphp: Slot [30] registered gitlab # [ 0.633676] acpiphp: Slot [31] registered gitlab # [ 0.634474] PCI host bridge to bus 0000:00 gitlab # [ 0.635203] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] gitlab # [ 0.636644] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] gitlab # [ 0.637644] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] gitlab # [ 0.638644] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.640644] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.641657] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.643056] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.645239] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint gitlab # [ 0.647076] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint gitlab # [ 0.649691] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f] gitlab # [ 0.650643] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk gitlab # [ 0.652644] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk gitlab # [ 0.653643] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk gitlab # [ 0.654644] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk gitlab # [ 0.655848] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint gitlab # [ 0.658673] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f] gitlab # [ 0.660759] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint gitlab # [ 0.662915] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI gitlab # [ 0.663650] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB gitlab # [ 0.665866] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint gitlab # [ 0.677723] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] gitlab # [ 0.678658] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] gitlab # [ 0.679664] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref] gitlab # [ 0.681819] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] gitlab # [ 0.683407] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.687677] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] gitlab # [ 0.688620] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] gitlab # [ 0.690587] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] gitlab # [ 0.703744] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] gitlab # [ 0.711063] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.722676] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f] gitlab # [ 0.724666] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] gitlab # [ 0.727706] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] gitlab # [ 0.733810] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.744678] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf] gitlab # [ 0.746667] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] gitlab # [ 0.749704] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] gitlab # [ 0.755778] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.762679] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df] gitlab # [ 0.764659] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] gitlab # [ 0.766699] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] gitlab # [ 0.771373] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.781791] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] gitlab # [ 0.782653] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] gitlab # [ 0.783705] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] gitlab # [ 0.791008] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.801683] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff] gitlab # [ 0.803661] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] gitlab # [ 0.805690] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] gitlab # [ 0.810343] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.816891] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff] gitlab # [ 0.819661] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] gitlab # [ 0.821690] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] gitlab # [ 0.822649] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref] gitlab # [ 0.824935] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.828657] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] gitlab # [ 0.829654] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] gitlab # [ 0.831920] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.836685] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f] gitlab # [ 0.837585] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] gitlab # [ 0.838665] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] gitlab # [ 0.841922] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.846674] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f] gitlab # [ 0.848664] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff] gitlab # [ 0.850724] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] gitlab # [ 0.864376] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 gitlab # [ 0.867037] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 gitlab # [ 0.870017] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 gitlab # [ 0.872998] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 gitlab # [ 0.874856] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 gitlab # [ 0.880973] iommu: Default domain type: Translated gitlab # [ 0.882647] iommu: DMA domain TLB invalidation policy: lazy mode gitlab # [ 0.886190] ACPI: bus type USB registered gitlab # [ 0.887842] usbcore: registered new interface driver usbfs gitlab # [ 0.889700] usbcore: registered new interface driver hub gitlab # [ 0.890672] usbcore: registered new device driver usb gitlab # [ 0.894917] NetLabel: Initializing gitlab # [ 0.896648] NetLabel: domain hash size = 128 gitlab # [ 0.897647] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO gitlab # [ 0.899815] NetLabel: unlabeled traffic allowed by default gitlab # [ 0.901666] PCI: Using ACPI for IRQ routing gitlab # [ 0.903863] pci 0000:00:02.0: vgaarb: setting as boot VGA device gitlab # [ 0.904639] pci 0000:00:02.0: vgaarb: bridge control possible gitlab # [ 0.904639] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none gitlab # [ 0.907651] vgaarb: loaded gitlab # [ 0.908414] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 gitlab # [ 0.908644] hpet0: 3 comparators, 64-bit 100.000000 MHz counter gitlab # [ 0.915266] clocksource: Switched to clocksource kvm-clock gitlab # [ 0.920231] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.922067] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.925691] pnp: PnP ACPI init gitlab # [ 0.928702] pnp: PnP ACPI: found 6 devices gitlab # [ 0.943059] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns gitlab # [ 0.946861] clocksource: Switched to clocksource acpi_pm gitlab # [ 0.949523] NET: Registered PF_INET protocol family gitlab # [ 0.954743] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.982407] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.983989] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.985505] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.989433] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.990852] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.992414] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.994105] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.995581] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.997031] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.998106] NET: Registered PF_XDP protocol family gitlab # [ 0.999001] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] gitlab # [ 1.000105] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] gitlab # [ 1.001182] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] gitlab # [ 1.002321] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] gitlab # [ 1.003537] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 1.004957] pci 0000:00:01.0: PIIX3: Enabling Passive Release gitlab # [ 1.006005] pci 0000:00:00.0: Limiting direct PCI/PCI transfers gitlab # [ 1.008521] ACPI: \_SB_.LNKD: Enabled at IRQ 11 gitlab # [ 1.011452] PCI: CLS 0 bytes, default 64 gitlab # [ 1.012264] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) gitlab # [ 1.013717] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB) gitlab # [ 1.013857] Trying to unpack rootfs image as initramfs... gitlab # [ 1.014182] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns gitlab # [ 1.037200] Initialise system trusted keyrings gitlab # [ 1.038288] workingset: timestamp_bits=40 max_order=21 bucket_order=0 gitlab # [ 1.049742] Key type asymmetric registered gitlab # [ 1.050492] Asymmetric key parser 'x509' registered gitlab # [ 1.051437] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) gitlab # [ 1.052990] io scheduler mq-deadline registered gitlab # [ 1.053830] io scheduler kyber registered gitlab # [ 1.058032] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 1.059441] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A gitlab # [ 1.061759] Linux agpgart interface v0.103 gitlab # [ 1.062613] ACPI: bus type drm_connector registered gitlab # [ 1.065033] usbcore: registered new interface driver usbserial_generic gitlab # [ 1.066198] usbserial: USB Serial support registered for generic gitlab # [ 1.067233] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. gitlab # [ 1.067233] Please enable it if your BIOS has the CPPC option. gitlab # [ 1.069624] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled gitlab # [ 1.071056] drop_monitor: Initializing network drop monitor service gitlab # [ 1.072283] NET: Registered PF_INET6 protocol family gitlab # [ 1.074008] Segment Routing with IPv6 gitlab # [ 1.074769] In-situ OAM (IOAM) with IPv6 gitlab # [ 1.076992] IPI shorthand broadcast: enabled gitlab # [ 1.081540] sched_clock: Marking stable (933010616, 147588912)->(1102780856, -22181328) gitlab # [ 1.083387] registered taskstats version 1 gitlab # [ 1.084418] Loading compiled-in X.509 certificates gitlab # [ 1.094377] Demotion targets for Node 0: null gitlab # [ 1.095416] Key type .fscrypt registered gitlab # [ 1.096132] Key type fscrypt-provisioning registered gitlab # [ 1.097182] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 1.098165] ima: Allocated hash algorithm: sha1 gitlab # [ 1.099027] ima: No architecture policies found gitlab # [ 1.100129] PM: Magic number: 10:424:116 gitlab # [ 1.101875] RAS: Correctable Errors collector initialized. gitlab # [ 1.106363] clk: Disabling unused clocks gitlab # [ 1.107085] PM: genpd: Disabling unused power domains gitlab # [ 1.304452] Freeing initrd memory: 29392K gitlab # [ 1.308255] Freeing unused decrypted memory: 2028K gitlab # [ 1.311081] Freeing unused kernel image (initmem) memory: 3640K gitlab # [ 1.312225] Write protecting the kernel read-only data: 32768k gitlab # [ 1.314326] Freeing unused kernel image (text/rodata gap) memory: 1220K gitlab # [ 1.316012] Freeing unused kernel image (rodata/data gap) memory: 760K gitlab # [ 1.367346] x86/mm: Checked W+X mappings: passed, no W+X pages found. gitlab # [ 1.368510] Run /init as init process gitlab # [ 1.381558] systemd[1]: Inserted module 'autofs4' gitlab # [ 1.404408] fuse: init (API version 7.45) gitlab # [ 1.413165] ACPI: \_SB_.LNKC: Enabled at IRQ 10 gitlab # [ 1.420247] ACPI: \_SB_.LNKA: Enabled at IRQ 10 gitlab # [ 1.423540] ACPI: \_SB_.LNKB: Enabled at IRQ 11 gitlab # [ 1.458397] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.795286] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.836691] systemd[1]: Detected virtualization kvm. gitlab # [ 1.838881] systemd[1]: Detected architecture x86-64. gitlab # [ 1.841052] systemd[1]: Running in initrd. gitlab # [ 1.843510] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.846462] systemd[1]: Hostname set to . gitlab # [ 1.956983] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.999459] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 2.010245] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 2.011428] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 2.012895] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 2.014087] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 2.015226] systemd[1]: Reached target Path Units. gitlab # [ 2.016114] systemd[1]: Reached target Slice Units. gitlab # [ 2.017033] systemd[1]: Reached target Swaps. gitlab # [ 2.017888] systemd[1]: Reached target Timer Units. gitlab # [ 2.018910] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 2.020173] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 2.021314] systemd[1]: Listening on Journal Sockets. gitlab # [ 2.022348] systemd[1]: Listening on udev Control Socket. gitlab # [ 2.023367] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 2.024326] systemd[1]: Reached target Socket Units. gitlab # [ 2.026331] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 2.028517] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 2.030527] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 2.033355] systemd[1]: Starting Journal Service... gitlab # [ 2.036673] systemd[1]: Starting Load Kernel Modules... gitlab # [ 2.039703] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 2.042655] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 2.049688] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 2.054675] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 2.058950] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 2.062449] systemd-journald[90]: Collecting audit messages is disabled. gitlab # [ 2.064038] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 2.065421] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config gitlab # [ 2.083691] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 2.086674] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 2.093640] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 2.096252] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 2.096664] netfs: FS-Cache loaded gitlab # [ 2.101960] systemd[1]: Finished Load Kernel Modules. gitlab # [ 2.108749] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 2.109944] 9pnet: Installing 9P2000 support gitlab # [ 2.110885] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 2.112261] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 2.113551] systemd[1]: Reached target Local File Systems. gitlab # [ 2.115827] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 2.118302] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 2.120891] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.980407] systemd-modules-load[92]: Using 4 probe threads gitlab # [ 2.128310] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.981824] systemd-modules-load[92]: Inserted module 'virtio_gpu' gitlab # [ 1.983180] systemd-modules-load[92]: Inserted module 'virtio_balloon' gitlab # [ 2.130717] systemd[1]: Started Journal Service. gitlab # [ 1.984295] systemd-modules-load[92]: Inserted module 'dm_mod' gitlab # [ 1.989668] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.998835] systemd-udevd[103]: Using default interface naming scheme 'v261'. gitlab # [ 2.006602] systemd[1]: Finished Create System Files and Directories. gitlab # [ 2.012093] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 2.048469] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.049553] systemd[1]: Reached target System Initialization. gitlab # [ 2.050425] systemd[1]: Reached target Basic System. gitlab # [ 2.267549] uhci_hcd 0000:00:01.2: UHCI Host Controller gitlab # [ 2.268402] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 gitlab # [ 2.270123] uhci_hcd 0000:00:01.2: detected 2 ports gitlab # [ 2.271246] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140 gitlab # [ 2.272555] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 gitlab # [ 2.275152] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 gitlab # [ 2.276838] usb usb1: Product: UHCI Host Controller gitlab # [ 2.278192] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd gitlab # [ 2.279271] usb usb1: SerialNumber: 0000:00:01.2 gitlab # [ 2.281966] hub 1-0:1.0: USB hub found gitlab # [ 2.282636] hub 1-0:1.0: 2 ports detected gitlab # [ 2.287068] SCSI subsystem initialized gitlab # [ 2.288758] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 2.297510] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 2.304461] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 2.317998] virtio_blk virtio5: [vdb] 11843184 512-byte logical blocks (6.06 GB/5.65 GiB) gitlab # [ 2.339299] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 gitlab # [ 2.340466] scsi host0: ata_piix gitlab # [ 2.341608] serio: i8042 KBD port at 0x60,0x64 irq 1 gitlab # [ 2.342351] serio: i8042 AUX port at 0x60,0x64 irq 12 gitlab # [ 2.344075] scsi host1: ata_piix gitlab # [ 2.344846] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0 gitlab # [ 2.346031] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0 gitlab # [ 2.208766] (udev-worker)[119]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.211594] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.212510] (udev-worker)[119]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.215597] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.228949] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.231363] systemd-vconsole-setup[148]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.234095] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.235530] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.236381] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.237414] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.264095] systemd-fsck[155]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.266956] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.504817] usb 1-1: new full-speed USB device number 2 using uhci_hcd gitlab # [ 2.505059] ata2: found unknown device (class 0) gitlab # [ 2.510172] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 gitlab # [ 2.514708] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 gitlab # [ 2.544146] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 gitlab # [ 2.574044] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray gitlab # [ 2.601323] cdrom: Uniform CD-ROM driver Revision: 3.20 gitlab # [ 2.673194] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 gitlab # [ 2.676213] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 gitlab # [ 2.678931] usb 1-1: Product: QEMU USB Tablet gitlab # [ 2.680541] usb 1-1: Manufacturer: QEMU gitlab # [ 2.682024] usb 1-1: SerialNumber: 28754-0000:00:01.2-1 gitlab # [ 2.714759] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 2.728527] usbcore: registered new interface driver usbhid gitlab # [ 2.730939] usbhid: USB HID core driver gitlab # [ 2.740834] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 gitlab # [ 2.744581] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 gitlab # [ 2.899639] systemd[1]: Mounting /sysroot... gitlab # [ 3.188617] EXT4-fs (vda): mounted filesystem 16a95321-c36f-4b0e-8842-5ac76363770a r/w with ordered data mode. Quota mode: none. gitlab # [ 3.044806] systemd[1]: Mounted /sysroot. gitlab # [ 3.046158] systemd[1]: Reached target Initrd Root File System. gitlab # [ 3.048403] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.050209] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.052789] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.053746] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.063509] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.065308] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.218145] 9p: Installing v9fs 9p2000 file system support gitlab # [ 3.073065] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 3.074312] systemd-sysroot-fstab-check[176]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.076033] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.076975] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.079517] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.083150] systemd[1]: Reload requested from client PID 176 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.085053] systemd[1]: Reloading... gitlab # [ 3.242639] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 3.144997] systemd[1]: Reloading finished in 62 ms. gitlab # [ 3.168713] systemd-sysroot-fstab-check[176]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.170374] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.171407] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.172585] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.174109] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.177690] systemd-sysroot-fstab-check[176]: Requesting swap.target/start/replace... gitlab # [ 3.180390] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.182119] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.183548] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.184939] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.214486] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.215820] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.900489] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.945075] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.946351] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.948436] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.950263] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.970606] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.972215] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.990099] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.991336] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.992779] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 4.021247] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 4.022507] systemd[1]: Stopped target Basic System. gitlab # [ 4.023616] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 4.024758] systemd[1]: Stopped target Path Units. gitlab # [ 4.025802] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 4.027278] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 4.028696] systemd[1]: Stopped target Slice Units. gitlab # [ 4.029784] systemd[1]: Stopped target Socket Units. gitlab # [ 4.030820] systemd[1]: Stopped target System Initialization. gitlab # [ 4.032680] systemd[1]: Stopped target Swaps. gitlab # [ 4.033692] systemd[1]: Stopped target Timer Units. gitlab # [ 4.035295] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 4.037329] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 4.038529] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 4.039927] systemd[1]: Stopped Find NixOS closure. gitlab # [ 4.041979] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 4.043873] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 4.045551] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 4.046820] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 4.047951] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 4.049570] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 4.050703] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 4.052165] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 4.053638] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 4.055216] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 4.056439] systemd[1]: Stopped target Local File Systems. gitlab # [ 4.057556] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 4.058835] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 4.060205] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 4.061348] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 4.062737] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 4.064139] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 4.065224] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 4.066534] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 4.067838] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 4.069171] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 4.070364] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 4.071561] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.072601] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 4.073796] systemd[1]: Closed udev Control Socket. gitlab # [ 4.074716] systemd[1]: Starting Cleanup udev Database... gitlab # [ 4.075685] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 4.076972] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 4.078126] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 4.079520] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 4.080709] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 4.081821] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.082914] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.084344] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.085398] systemd[1]: Reached target Switch Root. gitlab # [ 4.086312] systemd[1]: Starting NixOS Activation... gitlab # [ 4.165168] initrd-nixos-activation-start[224]: booting system configuration /nix/store/pjxpj4wzxavf7p9xvm6ciy6ix5c8rs57-nixos-system-gitlab-test gitlab # [ 4.193206] initrd-nixos-activation-start[224]: running activation script... gitlab # [ 4.438747] initrd-nixos-activation-start[248]: setting up /etc... gitlab # [ 4.550077] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.552571] systemd[1]: Finished NixOS Activation. gitlab # [ 4.554334] systemd[1]: Starting Switch Root... gitlab # [ 4.572398] systemd[1]: Switching root. gitlab # [ 4.787839] systemd-journald[90]: Received SIGTERM from PID 1 (systemd). gitlab # [ 4.891098] NET: Registered PF_VSOCK protocol family gitlab # [ 5.255936] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.260913] systemd[1]: Detected virtualization kvm. gitlab # [ 5.262723] systemd[1]: Detected architecture x86-64. gitlab # [ 5.264666] systemd[1]: Detected first boot. gitlab # [ 5.267215] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.419567] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.502717] systemd[1]: Applying preset policy. gitlab # [ 5.683330] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 5.805721] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 5.807100] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 5.809502] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 5.811839] systemd[1]: Created slice Slice /system/getty. gitlab # [ 5.813196] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 5.814719] systemd[1]: Created slice User and Session Slice. gitlab # [ 5.815782] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 5.817009] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 5.818148] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 5.818872] systemd[1]: Expecting device /dev/ttyS0... gitlab # [ 5.819659] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 5.820552] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 5.821347] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 5.822149] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 5.823025] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 5.824007] systemd[1]: Reached target Path Units. gitlab # [ 5.824756] systemd[1]: Reached target Remote File Systems. gitlab # [ 5.825594] systemd[1]: Reached target Slice Units. gitlab # [ 5.826285] systemd[1]: Reached target Swaps. gitlab # [ 5.827821] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 5.829848] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 5.831223] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 5.833252] systemd[1]: Listening on Factory Reset Management. gitlab # [ 5.834229] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 5.836636] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 5.838216] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 5.840208] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 5.841411] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 5.842605] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.843974] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 5.846737] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 5.847855] systemd[1]: Listening on udev Control Socket. gitlab # [ 5.848790] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 5.851822] systemd[1]: Mounting Huge Pages File System... gitlab # [ 5.853958] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 5.856179] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 5.859732] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 5.867816] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 5.868991] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 5.873548] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 5.887134] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 5.888938] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 5.891046] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 5.898705] systemd[1]: Mounting FUSE Control File System... gitlab # [ 5.899644] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 5.907687] systemd[1]: Starting Journal Service... gitlab # [ 5.910877] systemd[1]: Starting Load Kernel Modules... gitlab # [ 5.927180] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 5.933829] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 5.934967] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.938543] systemd-journald[320]: Collecting audit messages is enabled. gitlab # [ 5.940714] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 5.942759] loop: module loaded gitlab # [ 5.949619] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 5.950806] systemd[1]: Mounted Huge Pages File System. gitlab # [ 5.951785] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 5.952871] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 5.953871] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 5.955292] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 5.956547] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 5.809497] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 5.958012] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 5.811329] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 5.959411] systemd[1]: Started Journal Service. gitlab # [ 5.812792] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 5.814221] systemd-modules-load[321]: Using 3 probe threads gitlab # [ 5.962355] EXT4-fs (vda): re-mounted 16a95321-c36f-4b0e-8842-5ac76363770a. gitlab # [ 5.816688] systemd-modules-load[321]: Inserted module 'loop' gitlab # [ 5.817602] systemd-modules-load[321]: Inserted module 'tls' gitlab # [ 5.818951] systemd[1]: Mounted FUSE Control File System. gitlab # [ 5.819809] systemd[1]: Finished Load Kernel Modules. gitlab # [ 5.820711] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 5.822358] systemd[1]: Starting Firewall... gitlab # [ 5.824055] systemd-oomd[323]: No swap; memory pressure usage will be degraded gitlab # [ 5.825472] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 5.833401] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 5.834938] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 5.840355] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 5.841465] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 5.846601] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 5.847795] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 5.848873] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 5.850761] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 5.851863] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.855456] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 5.861083] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 5.863666] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.013980] systemd-journald[320]: Received client request to flush runtime journal. gitlab # [ 5.905914] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 5.907278] systemd[1]: Reached target First Boot Complete. gitlab # [ 5.908513] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 5.911121] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 5.912104] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 5.913255] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 5.915187] systemd-udevd[360]: Using default interface naming scheme 'v261'. gitlab # [ 5.947235] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 5.962895] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 6.016480] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.032360] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 6.044961] (udev-worker)[441]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.055020] (udev-worker)[417]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 6.057171] (udev-worker)[417]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.058371] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. gitlab # [ 6.073852] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 6.075298] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.076743] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.078959] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.080549] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.081760] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.099818] systemd[1]: Finished Firewall. gitlab # [ 6.267830] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 gitlab # [ 6.269498] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console gitlab # [ 6.271214] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 gitlab # [ 6.271310] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD gitlab # [ 6.276662] ACPI: button: Power Button [PWRF] gitlab # [ 6.292983] Console: switching to colour dummy device 80x25 gitlab # [ 6.295948] [drm] Found bochs VGA, ID 0xb0c5. gitlab # [ 6.295950] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. gitlab # [ 6.299085] rtc_cmos 00:05: RTC can wake from S4 gitlab # [ 6.300110] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic gitlab # [ 6.300497] Floppy drive(s): gitlab # [ 6.300919] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0 gitlab # [ 6.301014] fd0 is 2.88M AMI BIOS gitlab # [ 6.307006] parport_pc 00:03: reported by Plug and Play ACPI gitlab # [ 6.309195] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] gitlab # [ 6.309671] mousedev: PS/2 mouse device common for all mice gitlab # [ 6.317132] FDC 0 is a S82078B gitlab # [ 6.318265] Console: switching to colour frame buffer device 160x50 gitlab # [ 6.319730] rtc_cmos 00:05: registered as rtc0 gitlab # [ 6.320352] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device gitlab # [ 6.321749] rtc_cmos 00:05: setting system clock to 2026-09-08T07:08:46 UTC (1788851326) gitlab # [ 6.323203] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs gitlab # [ 6.329129] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4 gitlab # [ 6.330133] systemd-journald[320]: Time jumped backwards, rotating. gitlab # [ 6.344040] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 gitlab # [ 6.354792] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 gitlab # [ 6.242578] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.256407] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.257701] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.416022] ppdev: user-space parallel port driver gitlab # [ 6.276111] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.297918] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.299123] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.303060] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.475562] kvm_amd: TSC scaling supported gitlab # [ 6.476130] kvm_amd: Nested Virtualization enabled gitlab # [ 6.476938] kvm_amd: Nested Paging enabled gitlab # [ 6.477462] kvm_amd: LBR virtualization supported gitlab # [ 6.478276] kvm_amd: Virtual VMLOAD VMSAVE supported gitlab # [ 6.479019] kvm_amd: Virtual GIF supported gitlab # [ 6.479681] kvm_amd: Virtual NMI enabled gitlab # [ 6.372693] systemd-vconsole-setup[496]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 6.375218] systemd[1]: Finished Virtual Console Setup. gitlab # [ 6.585955] EDAC MC: Ver: 3.0.0 gitlab # [ 6.663191] systemd[1]: Mounting /run/wrappers... gitlab # [ 6.686464] systemd[1]: Mounted /run/wrappers. gitlab # [ 6.688256] systemd[1]: Reached target Local File Systems. gitlab # [ 6.690206] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 6.692407] systemd[1]: Starting register-nix-paths.service... gitlab # [ 6.694345] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 6.696392] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 6.699284] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 6.705219] systemd[1]: Starting Create System Files and Directories... gitlab # [ 6.738718] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 6.743168] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 6.748038] systemd[1]: Finished Create System Files and Directories. gitlab # [ 6.754796] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 6.758067] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 6.785845] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 6.801615] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 6.802946] systemd[1]: Starting Update is Completed... gitlab # [ 6.817615] systemd[1]: Finished Update is Completed. gitlab # [ 6.840524] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 6.841712] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.074886] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.077200] systemd[1]: Reached target System Initialization. gitlab # [ 7.079295] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.081755] systemd[1]: Started logrotate.timer. gitlab # [ 7.083542] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.085766] systemd[1]: Reached target Timer Units. gitlab # [ 7.087611] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.089891] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.091769] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.093756] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.096607] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.098712] systemd[1]: Reached target Socket Units. gitlab # [ 7.100638] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.170092] dbus-broker-launch[578]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.173598] dbus-broker-launch[578]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.176413] dbus-broker-launch[578]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.181611] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.202401] dbus-broker-launch[578]: Ready gitlab # [ 7.206813] systemd[1]: Reached target Basic System. gitlab # [ 7.209700] systemd[1]: Started backdoor.service. gitlab # [ 7.212387] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.215066] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.218754] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.228188] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.236557] systemd[1]: Starting Post-Boot Actions... gitlab # [ 7.246123] systemd[1]: Started Reset console on configuration changes. gitlab # [ 7.248775] systemd[1]: Starting resolvconf update... gitlab # [ 7.254470] logrotate[583]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 7.258652] logrotate[583]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf gitlab # connecting to host... gitlab # [ 7.261920] logrotate[583]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 7.263237] logrotate[583]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.263757] logrotate[583]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.264679] logrotate[583]: Allocating hash table for state file, size 64 entries gitlab # [ 7.266049] logrotate[583]: Handling 4 logs gitlab # [ 7.266892] logrotate[583]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.268620] logrotate[583]: considering log /var/log/btmp gitlab # [ 7.269820] logrotate[583]: Creating new state gitlab # [ 7.270616] logrotate[583]: Now: 2026-09-08 07:08 gitlab # [ 7.271416] logrotate[583]: Last rotated at 2026-09-08 07:00 gitlab # [ 7.272110] logrotate[583]: log does not need rotating (log has already been rotated) gitlab # [ 7.272767] logrotate[583]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.273610] logrotate[583]: considering log /var/log/wtmp gitlab # [ 7.274229] logrotate[583]: Creating new state gitlab # [ 7.275048] logrotate[583]: Now: 2026-09-08 07:08 gitlab # [ 7.275469] logrotate[583]: Last rotated at 2026-09-08 07:00 gitlab # [ 7.275927] logrotate[583]: log does not need rotating (log has already been rotated) gitlab # [ 7.276555] logrotate[583]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.277056] logrotate[583]: switching euid from 0 to 165 and egid from 0 to 165 (pid 583) gitlab # [ 7.277537] logrotate[583]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.278048] logrotate[583]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.278489] logrotate[583]: Creating new state gitlab # [ 7.278966] logrotate[583]: switching euid from 165 to 0 and egid from 165 to 0 (pid 583) gitlab: connected to guest root shell gitlab # [ 7.279661] logrotate[583]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab: (connecting took 7.91 seconds) gitlab # [ 7.280206] logrotate[583]: switching euid from 0 to 60 and egid from 0 to 60 (pid 583) gitlab: (finished: waiting for the VM to finish booting, in 7.91 seconds) gitlab # [ 7.280719] logrotate[583]: considering log /var/log/nginx/*.log gitlab # [ 7.281397] logrotate[583]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.281912] logrotate[583]: Creating new state gitlab # [ 7.282549] logrotate[583]: not running postrotate script, since no logs were rotated gitlab # [ 7.283058] logrotate[583]: switching euid from 60 to 0 and egid from 60 to 0 (pid 583) gitlab # [ 7.283911] nsncd[584]: Sep 08 07:08:47.593 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.295807] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.301042] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.303058] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.306922] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 7.310494] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.311191] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.313626] systemd[1]: Starting User Login Management... gitlab # [ 7.351624] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 7.353095] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 7.353730] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 7.354437] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 7.354994] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 7.356336] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 7.356770] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 7.357545] systemd[1]: nscd.service: Consumed 24ms CPU time over 126ms wall clock time, 7.7M memory peak, 5.5M read from disk. gitlab # [ 7.359134] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.365517] systemd-logind[618]: New seat seat0. gitlab # [ 7.368254] systemd-logind[618]: Watching system buttons on /dev/input/event2 (Power Button) gitlab # [ 7.369318] systemd-logind[618]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 7.369840] systemd-logind[618]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) gitlab # [ 7.370924] systemd[1]: Started User Login Management. gitlab # [ 7.374787] systemd[1]: Starting linger-users.service... gitlab # [ 7.378369] nsncd[674]: Sep 08 07:08:47.703 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.379142] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.379802] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.380507] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.391050] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 7.391755] systemd[1]: Finished linger-users.service. gitlab # [ 7.397184] systemd[1]: Finished resolvconf update. gitlab # [ 7.397827] systemd[1]: Reached target Preparation for Network. gitlab # [ 7.399844] systemd[1]: Starting DHCP Client... gitlab # [ 7.403091] systemd[1]: Starting Address configuration of eth1... gitlab # [ 7.404326] systemd[1]: Starting Extra networking commands.... gitlab # [ 7.430255] network-addresses-eth1-start[702]: adding address 192.168.1.1/24... done gitlab # [ 7.435088] network-addresses-eth1-start[702]: adding address 2001:db8:1::1/64... done gitlab # [ 7.439927] systemd[1]: Finished Address configuration of eth1. gitlab # [ 7.464368] systemd[1]: Finished Extra networking commands.. gitlab # [ 7.465570] dhcpcd[710]: dhcpcd-10.3.2 starting gitlab # [ 7.466371] systemd[1]: Reached target Network. gitlab # [ 7.468453] dhcpcd[767]: dev: loaded udev gitlab # [ 7.469187] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 7.471908] systemd[1]: Starting Nginx Web Server... gitlab # [ 7.474762] systemd[1]: Starting PostgreSQL Server... gitlab # [ 7.623323] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 7.623918] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 7.477669] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 7.479761] systemd[1]: Starting Permit User Sessions... gitlab # [ 7.491309] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 7.497291] systemd[1]: Finished Permit User Sessions. gitlab # [ 7.501432] systemd[1]: Started Getty on tty1. gitlab # [ 7.504119] systemd[1]: Reached target Login Prompts. gitlab # [ 7.707224] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 7.711146] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 7.711969] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 7.713426] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 7.714943] cfg80211: failed to load regulatory.db gitlab # [ 7.738037] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 7.592196] dhcpcd[767]: eth0: waiting for carrier gitlab # [ 7.593090] dhcpcd[767]: eth0: carrier acquired gitlab # [ 7.597090] dhcpcd[767]: DUID 00:01:00:01:32:32:70:ff:52:54:00:12:34:56 gitlab # [ 7.597827] dhcpcd[767]: eth0: IAID 00:12:34:56 gitlab # [ 7.598658] dhcpcd[767]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 7.614764] postgresql-pre-start[793]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 7.615611] postgresql-pre-start[793]: This user must also own the server process. gitlab # [ 7.620324] postgresql-pre-start[793]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 7.621044] postgresql-pre-start[793]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 7.621389] postgresql-pre-start[793]: The default text search configuration will be set to "english". gitlab # [ 7.621964] postgresql-pre-start[793]: Data page checksums are enabled. gitlab # [ 7.622734] postgresql-pre-start[793]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 7.623213] postgresql-pre-start[793]: creating subdirectories ... ok gitlab # [ 7.623678] postgresql-pre-start[793]: selecting dynamic shared memory implementation ... posix gitlab # [ 7.634265] redis-server[791]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 7.634994] redis-server[791]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 7.635701] redis-server[791]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=791, just started gitlab # [ 7.636401] redis-server[791]: Configuration loaded gitlab # [ 7.637244] redis[791]: monotonic clock: POSIX clock_gettime gitlab # [ 7.638207] nginx-pre-start[795]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok gitlab # [ 7.638810] nginx-pre-start[795]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful gitlab # [ 7.646606] systemd[1]: Started Nginx Web Server. gitlab # [ 7.647898] redis[791]: Running mode=standalone, port=0. gitlab # [ 7.649480] redis[791]: Server initialized gitlab # [ 7.651454] redis[791]: Ready to accept connections unix gitlab # [ 7.652681] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 7.653775] redis[791]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 7.655563] postgresql-pre-start[793]: selecting default "max_connections" ... 100 gitlab # [ 7.702489] postgresql-pre-start[793]: selecting default "shared_buffers" ... 128MB gitlab # [ 7.984957] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 8.104658] postgresql-pre-start[793]: selecting default time zone ... UTC gitlab # [ 8.106466] postgresql-pre-start[793]: creating configuration files ... ok gitlab # [ 8.156365] gitlab-workhorse[827]: time="2026-09-08T07:08:48Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 8.156957] gitlab-workhorse[827]: time="2026-09-08T07:08:48Z" level=info msg="Using redis/go-redis" gitlab # [ 8.157579] gitlab-workhorse[827]: time="2026-09-08T07:08:48Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 8.278094] postgresql-pre-start[793]: running bootstrap script ... ok gitlab # [ 8.663437] postgresql-pre-start[793]: performing post-bootstrap initialization ... ok gitlab # [ 8.921409] postgresql-pre-start[793]: syncing data to disk ... ok gitlab # [ 8.923107] postgresql-pre-start[793]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 8.924150] postgresql-pre-start[793]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 8.925409] postgresql-pre-start[793]: Success. You can now start the database server using: gitlab # [ 8.926994] postgresql-pre-start[793]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 9.057688] postgres[851]: [851] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 9.058787] postgres[851]: [851] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 9.059713] postgres[851]: [851] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 9.063635] postgres[851]: [851] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 9.079394] dhcpcd[767]: eth0: soliciting a DHCP lease gitlab # [ 9.081080] postgres[861]: [861] LOG: database system was shut down at 2026-09-08 07:08:48 GMT gitlab # [ 9.086209] postgres[851]: [851] LOG: database system is ready to accept connections gitlab # [ 9.238038] NET: Registered PF_PACKET protocol family gitlab # [ 9.091511] systemd[1]: Started PostgreSQL Server. gitlab # [ 9.096279] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 9.105183] dhcpcd[767]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 9.109274] dhcpcd[767]: eth0: probing address 10.0.2.15/24 gitlab # [ 9.274797] postgresql-setup-start[876]: CREATE DATABASE gitlab # [ 9.293991] postgresql-setup-start[884]: CREATE ROLE gitlab # [ 9.306179] postgresql-setup-start[886]: ALTER DATABASE gitlab # [ 9.325810] postgresql-setup-start[891]: CREATE ROLE gitlab # [ 9.327708] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 9.328969] systemd[1]: Reached target PostgreSQL. gitlab # [ 9.331079] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 9.335096] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[879]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 9.337612] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[879]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 9.374644] systemd[1]: Finished gitlab-config.service. gitlab # [ 9.376434] systemd[1]: Started gitaly.service. gitlab # [ 9.377775] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 9.426099] gitlab-postgresql-start[908]: CREATE DATABASE gitlab # [ 9.457421] gitlab-postgresql-start[929]: CREATE EXTENSION gitlab # [ 9.534136] gitlab-postgresql-start[931]: CREATE EXTENSION gitlab # [ 9.539809] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 9.851894] gitaly[913]: time="2026-09-08T07:08:50.176Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=913 gitlab # [ 9.860284] gitaly[913]: time="2026-09-08T07:08:50.177Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=913 gitlab # [ 9.865317] gitaly[913]: time="2026-09-08T07:08:50.177Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=913 gitlab # [ 9.870085] gitaly[913]: time="2026-09-08T07:08:50.177Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=913 gitlab # [ 9.874701] gitaly[913]: time="2026-09-08T07:08:50.177Z" level=info msg="Starting Gitaly" pid=913 version= gitlab # [ 9.979158] dhcpcd[767]: eth0: soliciting an IPv6 router gitlab # [ 9.981049] dhcpcd[767]: eth0: Router Advertisement from fe80::2 gitlab # [ 9.981923] dhcpcd[767]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 9.982874] dhcpcd[767]: eth0: adding route to fec0::/64 gitlab # [ 9.983737] dhcpcd[767]: eth0: adding default route via fe80::2 gitlab # [ 10.042213] gitaly[913]: time="2026-09-08T07:08:50.367Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=188 pid=913 gitlab # [ 10.044095] gitaly[913]: time="2026-09-08T07:08:50.368Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=913 gitlab # [ 10.045743] gitaly[913]: time="2026-09-08T07:08:50.368Z" level=info msg="finished initializing command factory" duration_ms=0 pid=913 gitlab # [ 10.047500] gitaly[913]: time="2026-09-08T07:08:50.368Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-913/git-exec-2842034628.d/git pid=913 gitlab # [ 10.049510] gitaly[913]: time="2026-09-08T07:08:50.372Z" level=info msg="finished detecting git version" duration_ms=3 pid=913 gitlab # [ 10.051128] gitaly[913]: time="2026-09-08T07:08:50.372Z" level=info msg="using Git version" pid=913 version=2.53.g gitlab # [ 10.052620] gitaly[913]: time="2026-09-08T07:08:50.372Z" level=info msg="clearing disk cache object folder" pid=913 storage=default gitlab # [ 10.054363] gitaly[913]: time="2026-09-08T07:08:50.373Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3400164507 pid=913 storage=default gitlab # [ 10.057107] gitaly[913]: time="2026-09-08T07:08:50.373Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3400164507 pid=913 storage=default gitlab # [ 10.060042] gitaly[913]: time="2026-09-08T07:08:50.373Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=913 gitlab # [ 10.062724] gitaly[913]: time="2026-09-08T07:08:50.373Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=913 gitlab # [ 10.065365] gitaly[913]: time="2026-09-08T07:08:50.373Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3400164507 clear_duration_ms=0 pid=913 storage=default gitlab # [ 10.082903] gitaly[913]: time="2026-09-08T07:08:50.408Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=913 gitlab # [ 10.084898] gitaly[913]: time="2026-09-08T07:08:50.408Z" level=info msg="counting repositories" pid=913 gitlab # [ 10.086316] gitaly[913]: time="2026-09-08T07:08:50.408Z" level=info msg="starting to count repositories" pid=913 storage_path=/var/gitlab/state/repositories gitlab # [ 10.088458] gitaly[913]: time="2026-09-08T07:08:50.408Z" level=info msg="finished tempdir cleaner walk" pid=913 storage=default time_ms=0 gitlab # [ 10.089030] gitaly[913]: time="2026-09-08T07:08:50.408Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=913 schema=unix gitlab # [ 10.089469] gitaly[913]: time="2026-09-08T07:08:50.408Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=913 storage_path=/var/gitlab/state/repositories gitlab # [ 10.089974] gitaly[913]: time="2026-09-08T07:08:50.408Z" level=info msg="completed counting all repositories" counting_duration=0 pid=913 gitlab # [ 10.090574] gitaly[913]: time="2026-09-08T07:08:50.408Z" level=info msg="listening at address" address=/run/gitaly/gitaly-913/sock.d/intern pid=913 schema=unix gitlab # [ 10.091118] gitaly[913]: time="2026-09-08T07:08:50.410Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=913 gitlab # [ 10.091522] gitaly[913]: time="2026-09-08T07:08:50.410Z" level=info msg="Started Gitaly" duration_ms=232 pid=913 gitlab # [ 10.092059] gitaly[913]: time="2026-09-08T07:08:50.410Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=913 gitlab # [ 10.092502] gitaly[913]: time="2026-09-08T07:08:50.410Z" level=info msg="maintenance: daily scheduled" pid=913 scheduled="2026-09-08 12:00:00 +0000 UTC" gitlab # [ 11.009892] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[920]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.011068] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[920]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.050720] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[920]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.007405] gitaly[913]: time="2026-09-08T07:08:52.332Z" level=info msg="License database preloaded" duration_ms=2154 pid=913 gitlab # [ 13.987215] dhcpcd[767]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 13.989356] dhcpcd[767]: eth0: adding route to 10.0.2.0/24 gitlab # [ 13.990810] dhcpcd[767]: eth0: adding default route via 10.0.2.2 gitlab # [ 14.106405] systemd[1]: Started DHCP Client. gitlab # [ 14.109193] systemd[1]: Reached target Network is Online. gitlab # [ 41.433328] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[920]: W, [2026-09-08T07:09:21.758260 #920] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 43.213256] postgres[1323]: [1323] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 43.215553] postgres[1323]: [1323] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 43.216947] postgres[1323]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 43.219204] postgres[1323]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 43.221195] postgres[1323]: attidentity AS identity, gitlab # [ 43.223123] postgres[1323]: attgenerated as attgenerated gitlab # [ 43.224972] postgres[1323]: FROM pg_attribute a gitlab # [ 43.227253] postgres[1323]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 43.229179] postgres[1323]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 43.230997] postgres[1323]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 43.232902] postgres[1323]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 43.235166] postgres[1323]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 43.237112] postgres[1323]: ORDER BY a.attnum gitlab # [ 43.238941] postgres[1323]: gitlab # [ 46.956775] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1356]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 46.959103] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1356]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 48.195366] gitlab-workhorse[827]: time="2026-09-08T07:09:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 58.206105] gitlab-workhorse[827]: time="2026-09-08T07:09:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 61.316823] postgres[1422]: [1422] ERROR: relation "table_without_models" does not exist gitlab # [ 61.319554] postgres[1422]: [1422] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 68.207123] gitlab-workhorse[827]: time="2026-09-08T07:09:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 73.719976] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 73.725342] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 73.728502] systemd[1]: Starting gitlab.service... gitlab # [ 74.085583] bundle[1598]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 74.086877] bundle[1598]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 74.090490] bundle[1598]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 76.785235] sidekiq-cluster[1597]: {"severity":"INFO","time":"2026-09-08T07:09:57.093Z","message":"Starting cluster with 1 processes"} gitlab # [ 76.875753] bundle[1598]: {"timestamp":"2026-09-08T07:09:57.181Z","pid":1598,"message":"* Enabling systemd notification integration"} gitlab # [ 76.876893] bundle[1598]: {"timestamp":"2026-09-08T07:09:57.200Z","pid":1598,"message":"Puma starting in cluster mode..."} gitlab # [ 76.877732] bundle[1598]: {"timestamp":"2026-09-08T07:09:57.200Z","pid":1598,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 76.878667] bundle[1598]: {"timestamp":"2026-09-08T07:09:57.200Z","pid":1598,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 76.879546] bundle[1598]: {"timestamp":"2026-09-08T07:09:57.200Z","pid":1598,"message":"* Min threads: 0"} gitlab # [ 76.880500] bundle[1598]: {"timestamp":"2026-09-08T07:09:57.200Z","pid":1598,"message":"* Max threads: 4"} gitlab # [ 76.881171] bundle[1598]: {"timestamp":"2026-09-08T07:09:57.200Z","pid":1598,"message":"* Environment: production"} gitlab # [ 76.881948] bundle[1598]: {"timestamp":"2026-09-08T07:09:57.200Z","pid":1598,"message":"* Master PID: 1598"} gitlab # [ 76.882580] bundle[1598]: {"timestamp":"2026-09-08T07:09:57.200Z","pid":1598,"message":"* Workers: 2"} gitlab # [ 76.883444] bundle[1598]: {"timestamp":"2026-09-08T07:09:57.201Z","pid":1598,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 76.884119] bundle[1598]: {"timestamp":"2026-09-08T07:09:57.201Z","pid":1598,"message":"* Preloading application"} gitlab # [ 78.217756] gitlab-workhorse[827]: time="2026-09-08T07:09:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 88.226371] gitlab-workhorse[827]: time="2026-09-08T07:10:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 98.235647] gitlab-workhorse[827]: time="2026-09-08T07:10:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 99.461365] bundle[1598]: W, [2026-09-08T07:10:19.786278 #1598] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 101.746270] sidekiq-cluster[1628]: 2026-09-08T07:10:22.071Z pid=1628 tid=wl0 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1628, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433831936} gitlab # [ 101.914086] sidekiq-cluster[1628]: W, [2026-09-08T07:10:22.239404 #1628] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 101.954630] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:22.280Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 103.924592] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.249Z","message":"GitLab reliable fetch activated!"} gitlab # [ 103.925742] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.249Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 103.951216] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.276Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 103.955749] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.281Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 103.960360] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.286Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 103.965189] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.290Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 103.969878] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.295Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 103.973995] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.299Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 103.978326] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.304Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 103.982275] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.307Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 103.986324] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.312Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 103.990355] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.316Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 103.994488] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.320Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 103.999058] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.324Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 104.003099] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.328Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 104.007329] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.333Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 104.011710] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.337Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 104.016117] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.341Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 104.023804] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.349Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 104.030078] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.355Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 104.036485] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.362Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 104.042850] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.368Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 104.051385] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.376Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 104.057092] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.382Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 104.062504] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.388Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 104.068680] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.394Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 104.074832] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.400Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 104.082796] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.408Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 104.090149] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.415Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 104.096456] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.422Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 104.103076] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.428Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 104.109608] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.435Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 104.115655] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.441Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 104.122360] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.448Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 104.128363] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.454Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 104.134744] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.460Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 104.140888] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.466Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 104.146342] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.472Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 104.152244] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.477Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 104.158298] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.483Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 104.163532] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.489Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 104.169948] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.495Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 104.176459] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.502Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 104.182904] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.508Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 104.188323] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.513Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 104.194894] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.520Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 104.202557] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.528Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 104.208313] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.533Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 104.213687] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.539Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 104.219341] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.544Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 104.225447] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.551Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 104.231549] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.557Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 104.237590] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.563Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 104.244190] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.569Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 104.264403] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.590Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 104.271870] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.597Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 104.279238] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.604Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 104.287941] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.613Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 104.296440] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.622Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 104.305535] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.631Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 104.313194] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.638Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 104.321351] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.647Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 104.329522] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.655Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 104.337808] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.663Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 104.346709] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.672Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 104.355436] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.681Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 104.365076] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.690Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 104.374834] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.700Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 104.382659] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.708Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 104.390120] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.715Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 104.397929] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.723Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 104.446695] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.772Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 104.454906] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.780Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 104.463190] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.788Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 104.471969] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.797Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 104.482327] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.807Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 104.491346] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.816Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 104.500249] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.825Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 104.509827] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.835Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 104.518742] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.844Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 104.527780] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.853Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 104.535779] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.861Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 104.544984] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.870Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 104.552503] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.878Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 104.562478] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.888Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 104.570098] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.895Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 104.578322] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.903Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 104.586538] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.912Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 104.594896] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.920Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 104.603234] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.928Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 104.610733] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.936Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 104.618789] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.944Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 104.626371] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.951Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 104.635819] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.961Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 104.643735] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.969Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 104.652264] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.977Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 104.660362] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.986Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 104.669683] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:24.995Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 104.677372] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:25.002Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 104.685718] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:25.011Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 104.705958] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:25.031Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 104.709996] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:25.034Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 104.715112] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:25.040Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 104.723763] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:25.049Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 104.733382] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:25.058Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 104.742749] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:25.068Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 104.751852] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:25.077Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 104.760112] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:25.085Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 104.767204] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:25.092Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 104.776977] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:25.102Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 104.784401] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:25.110Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 108.245805] gitlab-workhorse[827]: time="2026-09-08T07:10:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 118.256245] gitlab-workhorse[827]: time="2026-09-08T07:10:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 128.256949] gitlab-workhorse[827]: time="2026-09-08T07:10:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 129.270984] postgres[2075]: [2075] ERROR: relation "table_without_models" does not exist gitlab # [ 129.271736] postgres[2075]: [2075] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 129.761613] postgres[2086]: [2086] ERROR: relation "table_without_models" does not exist gitlab # [ 129.764425] postgres[2086]: [2086] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 131.831895] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:52.157Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 131.834064] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:52.159Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 131.834850] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:52.159Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 131.835944] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:52.159Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 131.850067] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:52.175Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 132.472875] bundle[1598]: {"timestamp":"2026-09-08T07:10:52.797Z","pid":1598,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 132.477187] bundle[1598]: {"timestamp":"2026-09-08T07:10:52.797Z","pid":1598,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 132.480967] bundle[1598]: {"timestamp":"2026-09-08T07:10:52.797Z","pid":1598,"message":"! #\u003cThread:0x00007e331893f3b8 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 132.495387] bundle[1598]: {"timestamp":"2026-09-08T07:10:52.798Z","pid":1598,"message":"! #\u003cThread:0x00007e3318bd81b0 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 132.506397] bundle[1598]: {"timestamp":"2026-09-08T07:10:52.798Z","pid":1598,"message":"Use Ctrl-C to stop"} gitlab # [ 132.509290] bundle[1598]: {"timestamp":"2026-09-08T07:10:52.798Z","pid":1598,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 132.832195] bundle[1598]: {"timestamp":"2026-09-08T07:10:53.157Z","pid":1598,"message":"- Worker 0 (PID: 2171) booted in 0.31s, phase: 0"} gitlab # [ 132.868292] bundle[1598]: {"timestamp":"2026-09-08T07:10:53.193Z","pid":1598,"message":"- Worker 1 (PID: 2175) booted in 0.33s, phase: 0"} gitlab # [ 132.873292] systemd[1]: Started gitlab.service. gitlab # [ 132.874972] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 132.881136] systemd[1]: Starting setup-gitlab.service... gitlab # [ 132.897766] setup-gitlab-start[2199]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 133.198283] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:53.523Z","message":"Cleaning working queues"} gitlab # [ 133.200384] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:53.525Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"96cab9fd7e6b356d359d9d1a","created_at":"2026-09-08T07:09:53.647Z","trace_propagation_headers":{"sentry-trace":"3135e764eac940e0836c7595412bdec9-ec478ed1ca7e4246","baggage":"sentry-trace_id=3135e764eac940e0836c7595412bdec9,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ec1bab2b392bef06bbb6804475e06d7a","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-08T07:09:53.654Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-96cab9fd7e6b356d359d9d1a: start","job_status":"start","queue_duration_s":59.869687,"scheduling_latency_s":59.869729} gitlab # [ 133.363668] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:10:53.688Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"96cab9fd7e6b356d359d9d1a","created_at":"2026-09-08T07:09:53.647Z","trace_propagation_headers":{"sentry-trace":"3135e764eac940e0836c7595412bdec9-ec478ed1ca7e4246","baggage":"sentry-trace_id=3135e764eac940e0836c7595412bdec9,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ec1bab2b392bef06bbb6804475e06d7a","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-08T07:09:53.654Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-96cab9fd7e6b356d359d9d1a: done: 0.16469 sec","job_status":"done","queue_duration_s":59.869687,"scheduling_latency_s":59.869729,"redis_calls":24,"redis_duration_s":0.005404,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.002334,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00197,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.088400061,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.16469,"completed_at":"2026-09-08T07:10:53.688Z","load_balancing_strategy":"primary","db_duration_s":0.053887,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 135.198986] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:10:55 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 2282 gitlab # [ 135.203796] setup-gitlab-start[2199]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 135.205332] setup-gitlab-start[2199]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 135.232496] runuser[2224]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 135.586544] setup-gitlab-start[2228]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 135.588375] setup-gitlab-start[2228]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 135.589930] setup-gitlab-start[2228]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 136.158877] setup-gitlab-start[2228]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 136.160480] setup-gitlab-start[2228]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 136.161944] setup-gitlab-start[2228]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 145.666797] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:05.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"3d867c81e106bb1146d62d3a","created_at":"2026-09-08T07:11:05.960Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b5de218e6c286398d631941f5797588","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:05.988Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-3d867c81e106bb1146d62d3a: start","job_status":"start","queue_duration_s":0.002781,"scheduling_latency_s":0.002833} gitlab # [ 145.779388] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.104Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"3d867c81e106bb1146d62d3a","created_at":"2026-09-08T07:11:05.960Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b5de218e6c286398d631941f5797588","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:05.988Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-3d867c81e106bb1146d62d3a: done: 0.1134 sec","job_status":"done","queue_duration_s":0.002781,"scheduling_latency_s":0.002833,"redis_calls":12,"redis_duration_s":0.007674,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001196,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002554,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003924,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001978463,"exclusive_lock_hold_duration_s":0.011088839999999999,"duration_s":0.1134,"completed_at":"2026-09-08T07:11:06.104Z","load_balancing_strategy":"primary","db_duration_s":0.017449,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.847840] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"aaf57200763cedebe9d13c99","created_at":"2026-09-08T07:11:06.045Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da83782974f8d60a3099850d4fba28eb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.059Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-aaf57200763cedebe9d13c99: start","job_status":"start","queue_duration_s":0.046036,"scheduling_latency_s":0.046051} gitlab # [ 145.860317] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.154Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 145.863561] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.160Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"aaf57200763cedebe9d13c99","created_at":"2026-09-08T07:11:06.045Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da83782974f8d60a3099850d4fba28eb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.059Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-aaf57200763cedebe9d13c99: done: 0.054821 sec","job_status":"done","queue_duration_s":0.046036,"scheduling_latency_s":0.046051,"redis_calls":10,"redis_duration_s":0.002913,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001184,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000626,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209804,"duration_s":0.054821,"completed_at":"2026-09-08T07:11:06.160Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039435,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.900490] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.161Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"43af1c6cb6d50dcd31a2c8a6","created_at":"2026-09-08T07:11:06.081Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c54fc280512fa0af8af91aa5588b2e22","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.114Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-43af1c6cb6d50dcd31a2c8a6: start","job_status":"start","queue_duration_s":0.047249,"scheduling_latency_s":0.047263} gitlab # [ 145.913246] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"43af1c6cb6d50dcd31a2c8a6","created_at":"2026-09-08T07:11:06.081Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c54fc280512fa0af8af91aa5588b2e22","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.114Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-43af1c6cb6d50dcd31a2c8a6: done: 0.021674 sec","job_status":"done","queue_duration_s":0.047249,"scheduling_latency_s":0.047263,"redis_calls":12,"redis_duration_s":0.003362,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000979,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00202,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000363,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000305625,"duration_s":0.021674,"completed_at":"2026-09-08T07:11:06.183Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.934092] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"19de1d810b96b3706c63746f","created_at":"2026-09-08T07:11:06.116Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0b0f0d0a4412cc6d44584ff43db2a36","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.119Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-19de1d810b96b3706c63746f: start","job_status":"start","queue_duration_s":0.070911,"scheduling_latency_s":0.070952} gitlab # [ 145.934840] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.220Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"19de1d810b96b3706c63746f","created_at":"2026-09-08T07:11:06.116Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0b0f0d0a4412cc6d44584ff43db2a36","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.119Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-19de1d810b96b3706c63746f: done: 0.030555 sec","job_status":"done","queue_duration_s":0.070911,"scheduling_latency_s":0.070952,"redis_calls":10,"redis_duration_s":0.011693,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001497,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005939,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004257,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001077791,"duration_s":0.030555,"completed_at":"2026-09-08T07:11:06.220Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000997,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.981116] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.222Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7c1d5509e911a4adfe9e7a0a","created_at":"2026-09-08T07:11:06.133Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64d4e865fff56b82f5dd90716cb3b1c8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.136Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7c1d5509e911a4adfe9e7a0a: start","job_status":"start","queue_duration_s":0.086728,"scheduling_latency_s":0.086742} gitlab # [ 145.981741] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.253Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 145.982525] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7c1d5509e911a4adfe9e7a0a","created_at":"2026-09-08T07:11:06.133Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64d4e865fff56b82f5dd90716cb3b1c8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.136Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7c1d5509e911a4adfe9e7a0a: done: 0.042155 sec","job_status":"done","queue_duration_s":0.086728,"scheduling_latency_s":0.086742,"redis_calls":10,"redis_duration_s":0.025547999999999998,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000872,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.023412,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001264,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002136026,"duration_s":0.042155,"completed_at":"2026-09-08T07:11:06.265Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.027768] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.271Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"faa51c15035278132f9f15a9","created_at":"2026-09-08T07:11:06.145Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12789e02c778ab7e3028d2caf8291e96","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.148Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-faa51c15035278132f9f15a9: start","job_status":"start","queue_duration_s":0.123538,"scheduling_latency_s":0.123553} gitlab # [ 146.076946] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"faa51c15035278132f9f15a9","created_at":"2026-09-08T07:11:06.145Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12789e02c778ab7e3028d2caf8291e96","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.148Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-faa51c15035278132f9f15a9: done: 0.130585 sec","job_status":"done","queue_duration_s":0.123538,"scheduling_latency_s":0.123553,"redis_calls":12,"redis_duration_s":0.00227,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00039,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000867,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.116,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.116,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000500343,"exclusive_lock_hold_duration_s":0.0026888899999999998,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.130585,"completed_at":"2026-09-08T07:11:06.402Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.115767,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.078697] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"fb3c99a764a93dbe85d8cab4","created_at":"2026-09-08T07:11:06.153Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"07b74fe24208a38f8373522447ce29e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.180Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-fb3c99a764a93dbe85d8cab4: start","job_status":"start","queue_duration_s":0.222759,"scheduling_latency_s":0.222775} gitlab # [ 146.130727] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.456Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 146.145655] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.470Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"fb3c99a764a93dbe85d8cab4","created_at":"2026-09-08T07:11:06.153Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"07b74fe24208a38f8373522447ce29e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.180Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-fb3c99a764a93dbe85d8cab4: done: 0.066877 sec","job_status":"done","queue_duration_s":0.222759,"scheduling_latency_s":0.222775,"redis_calls":10,"redis_duration_s":0.004997000000000001,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000531,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003937,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000529,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000830273,"duration_s":0.066877,"completed_at":"2026-09-08T07:11:06.470Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044612,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.166900] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.473Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a208eb1703e15ad1cd651720","created_at":"2026-09-08T07:11:06.190Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f782a9ac0f02ae21fcd402ba1b4906f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.203Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a208eb1703e15ad1cd651720: start","job_status":"start","queue_duration_s":0.269458,"scheduling_latency_s":0.269491} gitlab # [ 146.276804] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.601Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a208eb1703e15ad1cd651720","created_at":"2026-09-08T07:11:06.190Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f782a9ac0f02ae21fcd402ba1b4906f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.203Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a208eb1703e15ad1cd651720: done: 0.128324 sec","job_status":"done","queue_duration_s":0.269458,"scheduling_latency_s":0.269491,"redis_calls":14,"redis_duration_s":0.033737,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.029693,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002447,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001597,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000786133,"exclusive_lock_hold_duration_s":0.062203995,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.128324,"completed_at":"2026-09-08T07:11:06.601Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.279568] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"cf142db7e7e03223b514b69a","created_at":"2026-09-08T07:11:06.214Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab1cbe6d8a4b19c5cd1dea7c6621326c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T07:11:06.226Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-cf142db7e7e03223b514b69a: start","job_status":"start","queue_duration_s":0.377525,"scheduling_latency_s":0.377559} gitlab # [ 146.360618] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.686Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 146.372201] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.697Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"cf142db7e7e03223b514b69a","created_at":"2026-09-08T07:11:06.214Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab1cbe6d8a4b19c5cd1dea7c6621326c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T07:11:06.226Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-cf142db7e7e03223b514b69a: done: 0.093065 sec","job_status":"done","queue_duration_s":0.377525,"scheduling_latency_s":0.377559,"redis_calls":10,"redis_duration_s":0.003428,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0008,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001855,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000773,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.063,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000440838,"duration_s":0.093065,"completed_at":"2026-09-08T07:11:06.697Z","load_balancing_strategy":"primary","db_duration_s":0.063206,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.411475] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.736Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"257318bf08816d1607781a33","created_at":"2026-09-08T07:11:06.249Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d3eca01f0ee899051fccb5aad2a5993","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.257Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-257318bf08816d1607781a33: start","job_status":"start","queue_duration_s":0.478917,"scheduling_latency_s":0.478969} gitlab # [ 146.474716] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.799Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"257318bf08816d1607781a33","created_at":"2026-09-08T07:11:06.249Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d3eca01f0ee899051fccb5aad2a5993","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.257Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-257318bf08816d1607781a33: done: 0.063007 sec","job_status":"done","queue_duration_s":0.478917,"scheduling_latency_s":0.478969,"redis_calls":16,"redis_duration_s":0.005207,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002743,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001851,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000613,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000489448,"duration_s":0.063007,"completed_at":"2026-09-08T07:11:06.799Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.477314] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.802Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3430d56d87e2960f3a957fe8","created_at":"2026-09-08T07:11:06.270Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15759c35c4af3e674f9e71b10821c8f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.280Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3430d56d87e2960f3a957fe8: start","job_status":"start","queue_duration_s":0.522194,"scheduling_latency_s":0.522226} gitlab # [ 146.517538] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.842Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3430d56d87e2960f3a957fe8","created_at":"2026-09-08T07:11:06.270Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15759c35c4af3e674f9e71b10821c8f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.280Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3430d56d87e2960f3a957fe8: done: 0.040661 sec","job_status":"done","queue_duration_s":0.522194,"scheduling_latency_s":0.522226,"redis_calls":19,"redis_duration_s":0.00462,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001087,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.00034,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002404,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000789,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000270146,"duration_s":0.040661,"completed_at":"2026-09-08T07:11:06.842Z","load_balancing_strategy":"primary","db_duration_s":0.003648,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.535125] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.844Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"789da2a75a3bf9c247ef14d7","created_at":"2026-09-08T07:11:06.282Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ee85c4d8f3e1fd358ca13d5cec08d2f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.285Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-789da2a75a3bf9c247ef14d7: start","job_status":"start","queue_duration_s":0.558405,"scheduling_latency_s":0.558419} gitlab # [ 146.673454] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"789da2a75a3bf9c247ef14d7","created_at":"2026-09-08T07:11:06.282Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ee85c4d8f3e1fd358ca13d5cec08d2f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.285Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-789da2a75a3bf9c247ef14d7: done: 0.154037 sec","job_status":"done","queue_duration_s":0.558405,"scheduling_latency_s":0.558419,"redis_calls":12,"redis_duration_s":0.0024360000000000002,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000377,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001075,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.113684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000319035,"exclusive_lock_hold_duration_s":0.138068108,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.154037,"completed_at":"2026-09-08T07:11:06.998Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041619,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.676372] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:06.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"2f0940a3b360cdde57051199","created_at":"2026-09-08T07:11:06.287Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4725e7bb016d5778adfb7dcc321b7c63","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.290Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-2f0940a3b360cdde57051199: start","job_status":"start","queue_duration_s":0.70929,"scheduling_latency_s":0.709305} gitlab # [ 146.911683] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.237Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"2f0940a3b360cdde57051199","created_at":"2026-09-08T07:11:06.287Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4725e7bb016d5778adfb7dcc321b7c63","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.290Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-2f0940a3b360cdde57051199: done: 0.237668 sec","job_status":"done","queue_duration_s":0.70929,"scheduling_latency_s":0.709305,"redis_calls":565,"redis_duration_s":0.064442,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.063342,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.197324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000240254,"duration_s":0.237668,"completed_at":"2026-09-08T07:11:07.237Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.913798] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"53f6b755b0791fe14a1cb502","created_at":"2026-09-08T07:11:06.292Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6bed83df6af53e8244ef078845f3d66","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T07:11:06.294Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-53f6b755b0791fe14a1cb502: start","job_status":"start","queue_duration_s":0.944766,"scheduling_latency_s":0.944781} gitlab # [ 146.997834] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"53f6b755b0791fe14a1cb502","created_at":"2026-09-08T07:11:06.292Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6bed83df6af53e8244ef078845f3d66","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T07:11:06.294Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-53f6b755b0791fe14a1cb502: done: 0.025464 sec","job_status":"done","queue_duration_s":0.944766,"scheduling_latency_s":0.944781,"redis_calls":10,"redis_duration_s":0.001883,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000496,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001032,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000355,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000276851,"duration_s":0.025464,"completed_at":"2026-09-08T07:11:07.264Z","load_balancing_strategy":"primary","db_duration_s":0.00541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.033663] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.266Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a2764b07fcd99110feb7b0bd","created_at":"2026-09-08T07:11:06.299Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9c716f2f821bee0c3d3ab131cdc0a04","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.302Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a2764b07fcd99110feb7b0bd: start","job_status":"start","queue_duration_s":0.964012,"scheduling_latency_s":0.964026} gitlab # [ 147.045833] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a2764b07fcd99110feb7b0bd","created_at":"2026-09-08T07:11:06.299Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9c716f2f821bee0c3d3ab131cdc0a04","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.302Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a2764b07fcd99110feb7b0bd: done: 0.030926 sec","job_status":"done","queue_duration_s":0.964012,"scheduling_latency_s":0.964026,"redis_calls":10,"redis_duration_s":0.002003,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00041,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000394,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000262045,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.030926,"completed_at":"2026-09-08T07:11:07.296Z","load_balancing_strategy":"primary","db_duration_s":0.015927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.066842] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.298Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7c216598ac87c4711cb26f2f","created_at":"2026-09-08T07:11:06.308Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f469315267c8932c788946bbe31c6ba","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.314Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7c216598ac87c4711cb26f2f: start","job_status":"start","queue_duration_s":0.983931,"scheduling_latency_s":0.983945} gitlab # [ 147.067852] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.327Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7c216598ac87c4711cb26f2f","created_at":"2026-09-08T07:11:06.308Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f469315267c8932c788946bbe31c6ba","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.314Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7c216598ac87c4711cb26f2f: done: 0.029844 sec","job_status":"done","queue_duration_s":0.983931,"scheduling_latency_s":0.983945,"redis_calls":12,"redis_duration_s":0.002419,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000338,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000402565,"exclusive_lock_hold_duration_s":0.011942020000000001,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.029844,"completed_at":"2026-09-08T07:11:07.327Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011972,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.118953] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"cd58548f17809be2f8db465a","created_at":"2026-09-08T07:11:06.316Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.318Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-cd58548f17809be2f8db465a: start","job_status":"start","queue_duration_s":1.01023,"scheduling_latency_s":1.010243} gitlab # [ 147.119770] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.405Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"cd58548f17809be2f8db465a","created_at":"2026-09-08T07:11:06.316Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.318Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-cd58548f17809be2f8db465a: done: 0.076543 sec","job_status":"done","queue_duration_s":1.01023,"scheduling_latency_s":1.010243,"redis_calls":71,"redis_duration_s":0.020815,"redis_read_bytes":120,"redis_write_bytes":42524,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002624,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001072,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37335,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.016296,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000823,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000947327,"duration_s":0.076543,"completed_at":"2026-09-08T07:11:07.405Z","load_balancing_strategy":"primary","db_duration_s":0.001846,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.158850] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.407Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3d91c292e13513af67232e84","created_at":"2026-09-08T07:11:06.320Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7bd38d3de699ec9c7bd1e86083b5ca1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.323Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3d91c292e13513af67232e84: start","job_status":"start","queue_duration_s":1.084344,"scheduling_latency_s":1.084359} gitlab # [ 147.159696] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.416Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 147.162194] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.421Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3d91c292e13513af67232e84","created_at":"2026-09-08T07:11:06.320Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7bd38d3de699ec9c7bd1e86083b5ca1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.323Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3d91c292e13513af67232e84: done: 0.013909 sec","job_status":"done","queue_duration_s":1.084344,"scheduling_latency_s":1.084359,"redis_calls":10,"redis_duration_s":0.002059,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000477,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000259251,"duration_s":0.013909,"completed_at":"2026-09-08T07:11:07.421Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000564,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.210628] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.422Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"d89ce0a24370baa8ecc9c045","created_at":"2026-09-08T07:11:06.326Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.329Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-d89ce0a24370baa8ecc9c045: start","job_status":"start","queue_duration_s":1.093475,"scheduling_latency_s":1.093488} gitlab # [ 147.211740] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"d89ce0a24370baa8ecc9c045","created_at":"2026-09-08T07:11:06.326Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.329Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-d89ce0a24370baa8ecc9c045: done: 0.036892 sec","job_status":"done","queue_duration_s":1.093475,"scheduling_latency_s":1.093488,"redis_calls":28,"redis_duration_s":0.007446,"redis_read_bytes":36,"redis_write_bytes":10593,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000846,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.00053,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8305,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.004451,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001619,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000276292,"duration_s":0.036892,"completed_at":"2026-09-08T07:11:07.459Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003985,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.250288] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.460Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"df78674e518f9e61e7dacc63","created_at":"2026-09-08T07:11:06.339Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23530b5761c30cab68a97cac84dc9782","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.342Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-df78674e518f9e61e7dacc63: start","job_status":"start","queue_duration_s":1.118422,"scheduling_latency_s":1.118436} gitlab # [ 147.295582] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.478Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"df78674e518f9e61e7dacc63","created_at":"2026-09-08T07:11:06.339Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23530b5761c30cab68a97cac84dc9782","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.342Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-df78674e518f9e61e7dacc63: done: 0.017689 sec","job_status":"done","queue_duration_s":1.118422,"scheduling_latency_s":1.118436,"redis_calls":10,"redis_duration_s":0.002118,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001189,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000277409,"duration_s":0.017689,"completed_at":"2026-09-08T07:11:07.478Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.334165] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.479Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d18b6b92973133da5c9fc7f8","created_at":"2026-09-08T07:11:06.352Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b73c16e86f7d1ae263f65935d10a993a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T07:11:06.355Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d18b6b92973133da5c9fc7f8: start","job_status":"start","queue_duration_s":1.123728,"scheduling_latency_s":1.123741} gitlab # [ 147.335252] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.491Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 147.336295] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d18b6b92973133da5c9fc7f8","created_at":"2026-09-08T07:11:06.352Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b73c16e86f7d1ae263f65935d10a993a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T07:11:06.355Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d18b6b92973133da5c9fc7f8: done: 0.01947 sec","job_status":"done","queue_duration_s":1.123728,"scheduling_latency_s":1.123741,"redis_calls":10,"redis_duration_s":0.008432,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000984,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006406,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001018007,"duration_s":0.01947,"completed_at":"2026-09-08T07:11:07.499Z","load_balancing_strategy":"primary","db_duration_s":0.000505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.376797] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.500Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6a63b78d4f272333026d93b1","created_at":"2026-09-08T07:11:06.359Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ea88011c7d27899e478dda66c32970a","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.362Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6a63b78d4f272333026d93b1: start","job_status":"start","queue_duration_s":1.137565,"scheduling_latency_s":1.137579} gitlab # [ 147.377613] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6a63b78d4f272333026d93b1","created_at":"2026-09-08T07:11:06.359Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-63d546c8057d4c94","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ea88011c7d27899e478dda66c32970a","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.362Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6a63b78d4f272333026d93b1: done: 0.0215 sec","job_status":"done","queue_duration_s":1.137565,"scheduling_latency_s":1.137579,"redis_calls":13,"redis_duration_s":0.0027400000000000002,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000427,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001384,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0066064259999999994,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.0215,"completed_at":"2026-09-08T07:11:07.521Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002682,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 147.430521] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.523Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"13cb596d3eb4cfec38488ffd","created_at":"2026-09-08T07:11:06.822Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-3f75d817041c428e","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"15759c35c4af3e674f9e71b10821c8f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.837Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-13cb596d3eb4cfec38488ffd: start","job_status":"start","queue_duration_s":0.68582,"scheduling_latency_s":0.685833} gitlab # [ 147.431281] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.534Z","message":"No existing merge request to be cleaned up."} gitlab # [ 147.432622] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.545Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"13cb596d3eb4cfec38488ffd","created_at":"2026-09-08T07:11:06.822Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-3f75d817041c428e","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"15759c35c4af3e674f9e71b10821c8f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.837Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-13cb596d3eb4cfec38488ffd: done: 0.021996 sec","job_status":"done","queue_duration_s":0.68582,"scheduling_latency_s":0.685833,"redis_calls":13,"redis_duration_s":0.002853,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000407,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000993,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001453,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000297524,"duration_s":0.021996,"completed_at":"2026-09-08T07:11:07.545Z","load_balancing_strategy":"primary","db_duration_s":0.004765,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.476313] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.546Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"98fdf65f8e90d7cf32e3e3b0","created_at":"2026-09-08T07:11:06.822Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-3f75d817041c428e","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"15759c35c4af3e674f9e71b10821c8f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.837Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-98fdf65f8e90d7cf32e3e3b0: start","job_status":"start","queue_duration_s":0.708888,"scheduling_latency_s":0.708902} gitlab # [ 147.477122] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.553Z","message":"No existing merge request to be cleaned up."} gitlab # [ 147.477903] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.558Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"98fdf65f8e90d7cf32e3e3b0","created_at":"2026-09-08T07:11:06.822Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-3f75d817041c428e","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"15759c35c4af3e674f9e71b10821c8f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.837Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-98fdf65f8e90d7cf32e3e3b0: done: 0.012797 sec","job_status":"done","queue_duration_s":0.708888,"scheduling_latency_s":0.708902,"redis_calls":10,"redis_duration_s":0.002056,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00123,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012797,"completed_at":"2026-09-08T07:11:07.558Z","load_balancing_strategy":"primary","db_duration_s":0.001632,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.523300] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.560Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"954566816a1e0d7f3a7120be","created_at":"2026-09-08T07:11:06.822Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-3f75d817041c428e","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"15759c35c4af3e674f9e71b10821c8f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.837Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-954566816a1e0d7f3a7120be: start","job_status":"start","queue_duration_s":0.722876,"scheduling_latency_s":0.722889} gitlab # [ 147.524155] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.567Z","message":"No existing merge request to be cleaned up."} gitlab # [ 147.524990] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.572Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"954566816a1e0d7f3a7120be","created_at":"2026-09-08T07:11:06.822Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-3f75d817041c428e","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"15759c35c4af3e674f9e71b10821c8f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.837Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-954566816a1e0d7f3a7120be: done: 0.012617 sec","job_status":"done","queue_duration_s":0.722876,"scheduling_latency_s":0.722889,"redis_calls":10,"redis_duration_s":0.002133,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00126,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012617,"completed_at":"2026-09-08T07:11:07.572Z","load_balancing_strategy":"primary","db_duration_s":0.001549,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.571864] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.573Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"409b6adb7cc09dba4c866bba","created_at":"2026-09-08T07:11:06.822Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-3f75d817041c428e","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"15759c35c4af3e674f9e71b10821c8f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.837Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-409b6adb7cc09dba4c866bba: start","job_status":"start","queue_duration_s":0.736702,"scheduling_latency_s":0.736716} gitlab # [ 147.572662] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.584Z","message":"No existing merge request to be cleaned up."} gitlab # [ 147.573568] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.590Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"409b6adb7cc09dba4c866bba","created_at":"2026-09-08T07:11:06.822Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-3f75d817041c428e","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"15759c35c4af3e674f9e71b10821c8f7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:06.837Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-409b6adb7cc09dba4c866bba: done: 0.016179 sec","job_status":"done","queue_duration_s":0.736702,"scheduling_latency_s":0.736716,"redis_calls":10,"redis_duration_s":0.00408,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001797,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002283,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016179,"completed_at":"2026-09-08T07:11:07.590Z","load_balancing_strategy":"primary","db_duration_s":0.002335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.585854] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edc8fa9856997c5f73f4daf4","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edc8fa9856997c5f73f4daf4: start","job_status":"start","queue_duration_s":0.195131,"scheduling_latency_s":0.195144} gitlab # [ 147.597517] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edc8fa9856997c5f73f4daf4","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edc8fa9856997c5f73f4daf4: done: 0.016002 sec","job_status":"done","queue_duration_s":0.195131,"scheduling_latency_s":0.195144,"redis_calls":16,"redis_duration_s":0.003404,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000457,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001032,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001915,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000325181,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016002,"completed_at":"2026-09-08T07:11:07.607Z","load_balancing_strategy":"primary","db_duration_s":0.000422,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.637496] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a4de7637b2f16fc90a4210a","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a4de7637b2f16fc90a4210a: start","job_status":"start","queue_duration_s":0.212211,"scheduling_latency_s":0.212225} gitlab # [ 147.678365] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a4de7637b2f16fc90a4210a","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a4de7637b2f16fc90a4210a: done: 0.010956 sec","job_status":"done","queue_duration_s":0.212211,"scheduling_latency_s":0.212225,"redis_calls":13,"redis_duration_s":0.002604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001832,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010956,"completed_at":"2026-09-08T07:11:07.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.679464] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"046295e09c9f7336913c4bc5","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-046295e09c9f7336913c4bc5: start","job_status":"start","queue_duration_s":0.224218,"scheduling_latency_s":0.224232} gitlab # [ 147.717860] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"046295e09c9f7336913c4bc5","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-046295e09c9f7336913c4bc5: done: 0.012074 sec","job_status":"done","queue_duration_s":0.224218,"scheduling_latency_s":0.224232,"redis_calls":13,"redis_duration_s":0.002598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012074,"completed_at":"2026-09-08T07:11:07.632Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.720650] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f5ce44e4fe821e8f08e5d4e","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f5ce44e4fe821e8f08e5d4e: start","job_status":"start","queue_duration_s":0.237353,"scheduling_latency_s":0.237366} gitlab # [ 147.731238] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f5ce44e4fe821e8f08e5d4e","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f5ce44e4fe821e8f08e5d4e: done: 0.010808 sec","job_status":"done","queue_duration_s":0.237353,"scheduling_latency_s":0.237366,"redis_calls":13,"redis_duration_s":0.0027370000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010808,"completed_at":"2026-09-08T07:11:07.644Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.777139] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c77897e83020f2632fcf152","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c77897e83020f2632fcf152: start","job_status":"start","queue_duration_s":0.249379,"scheduling_latency_s":0.249392} gitlab # [ 147.777779] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c77897e83020f2632fcf152","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c77897e83020f2632fcf152: done: 0.010788 sec","job_status":"done","queue_duration_s":0.249379,"scheduling_latency_s":0.249392,"redis_calls":13,"redis_duration_s":0.002564,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001678,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010788,"completed_at":"2026-09-08T07:11:07.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.816619] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57b2985b2333017384c782bb","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57b2985b2333017384c782bb: start","job_status":"start","queue_duration_s":0.261349,"scheduling_latency_s":0.261363} gitlab # [ 147.819691] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57b2985b2333017384c782bb","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57b2985b2333017384c782bb: done: 0.013153 sec","job_status":"done","queue_duration_s":0.261349,"scheduling_latency_s":0.261363,"redis_calls":13,"redis_duration_s":0.005021,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001688,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003333,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013153,"completed_at":"2026-09-08T07:11:07.670Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.854672] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d57a2bf87d17e521de7d650b","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d57a2bf87d17e521de7d650b: start","job_status":"start","queue_duration_s":0.275759,"scheduling_latency_s":0.275771} gitlab # [ 147.897743] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d57a2bf87d17e521de7d650b","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d57a2bf87d17e521de7d650b: done: 0.010618 sec","job_status":"done","queue_duration_s":0.275759,"scheduling_latency_s":0.275771,"redis_calls":13,"redis_duration_s":0.002639,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001711,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010618,"completed_at":"2026-09-08T07:11:07.682Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.901571] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.683Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7013a22c8e16b5af36854645","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7013a22c8e16b5af36854645: start","job_status":"start","queue_duration_s":0.287538,"scheduling_latency_s":0.287554} gitlab # [ 147.945195] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7013a22c8e16b5af36854645","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7013a22c8e16b5af36854645: done: 0.010603 sec","job_status":"done","queue_duration_s":0.287538,"scheduling_latency_s":0.287554,"redis_calls":13,"redis_duration_s":0.0025180000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010603,"completed_at":"2026-09-08T07:11:07.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.946427] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d135bb824127316ec15aa0e5","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d135bb824127316ec15aa0e5: start","job_status":"start","queue_duration_s":0.299497,"scheduling_latency_s":0.299511} gitlab # [ 147.988516] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d135bb824127316ec15aa0e5","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d135bb824127316ec15aa0e5: done: 0.0167 sec","job_status":"done","queue_duration_s":0.299497,"scheduling_latency_s":0.299511,"redis_calls":13,"redis_duration_s":0.008457000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001331,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0167,"completed_at":"2026-09-08T07:11:07.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.027622] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b17b5e4b236f8a5ac0aeb2c","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b17b5e4b236f8a5ac0aeb2c: start","job_status":"start","queue_duration_s":0.322081,"scheduling_latency_s":0.322098} gitlab # [ 148.028509] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b17b5e4b236f8a5ac0aeb2c","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b17b5e4b236f8a5ac0aeb2c: done: 0.011016 sec","job_status":"done","queue_duration_s":0.322081,"scheduling_latency_s":0.322098,"redis_calls":13,"redis_duration_s":0.002515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001762,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011016,"completed_at":"2026-09-08T07:11:07.729Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.035779] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71f54653d391973f5763ced2","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71f54653d391973f5763ced2: start","job_status":"start","queue_duration_s":0.333967,"scheduling_latency_s":0.333979} gitlab # [ 148.073481] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71f54653d391973f5763ced2","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71f54653d391973f5763ced2: done: 0.010659 sec","job_status":"done","queue_duration_s":0.333967,"scheduling_latency_s":0.333979,"redis_calls":13,"redis_duration_s":0.002603,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000762,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001841,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010659,"completed_at":"2026-09-08T07:11:07.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.113582] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c7a6ca7f99c0788ba95c6d1","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c7a6ca7f99c0788ba95c6d1: start","job_status":"start","queue_duration_s":0.345633,"scheduling_latency_s":0.34567} gitlab # [ 148.114497] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c7a6ca7f99c0788ba95c6d1","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c7a6ca7f99c0788ba95c6d1: done: 0.010655 sec","job_status":"done","queue_duration_s":0.345633,"scheduling_latency_s":0.34567,"redis_calls":13,"redis_duration_s":0.002512,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001642,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010655,"completed_at":"2026-09-08T07:11:07.752Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.123237] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99807752c52d41db7fb2325d","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99807752c52d41db7fb2325d: start","job_status":"start","queue_duration_s":0.357326,"scheduling_latency_s":0.357339} gitlab # [ 148.160548] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99807752c52d41db7fb2325d","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99807752c52d41db7fb2325d: done: 0.015958 sec","job_status":"done","queue_duration_s":0.357326,"scheduling_latency_s":0.357339,"redis_calls":13,"redis_duration_s":0.007523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001453,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00607,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015958,"completed_at":"2026-09-08T07:11:07.769Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.166929] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cb90dad38a9b27797ec66d8","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cb90dad38a9b27797ec66d8: start","job_status":"start","queue_duration_s":0.374368,"scheduling_latency_s":0.374384} gitlab # [ 148.209260] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cb90dad38a9b27797ec66d8","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cb90dad38a9b27797ec66d8: done: 0.010801 sec","job_status":"done","queue_duration_s":0.374368,"scheduling_latency_s":0.374384,"redis_calls":13,"redis_duration_s":0.002535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001689,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010801,"completed_at":"2026-09-08T07:11:07.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.210570] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f41d26ea1b02651c68f34a3","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f41d26ea1b02651c68f34a3: start","job_status":"start","queue_duration_s":0.386288,"scheduling_latency_s":0.386302} gitlab # [ 148.254332] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f41d26ea1b02651c68f34a3","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f41d26ea1b02651c68f34a3: done: 0.010656 sec","job_status":"done","queue_duration_s":0.386288,"scheduling_latency_s":0.386302,"redis_calls":13,"redis_duration_s":0.002458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001692,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010656,"completed_at":"2026-09-08T07:11:07.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.255397] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6913048dfa352a83f8dea3b","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6913048dfa352a83f8dea3b: start","job_status":"start","queue_duration_s":0.398105,"scheduling_latency_s":0.398119} gitlab # [ 148.265256] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6913048dfa352a83f8dea3b","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6913048dfa352a83f8dea3b: done: 0.016024 sec","job_status":"done","queue_duration_s":0.398105,"scheduling_latency_s":0.398119,"redis_calls":13,"redis_duration_s":0.007731999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005671,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016024,"completed_at":"2026-09-08T07:11:07.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.331167] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"020771480ffd9294e460376d","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-020771480ffd9294e460376d: start","job_status":"start","queue_duration_s":0.41596,"scheduling_latency_s":0.415974} gitlab # [ 148.331811] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"020771480ffd9294e460376d","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-020771480ffd9294e460376d: done: 0.010591 sec","job_status":"done","queue_duration_s":0.41596,"scheduling_latency_s":0.415974,"redis_calls":13,"redis_duration_s":0.002406,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001627,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010591,"completed_at":"2026-09-08T07:11:07.822Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.375692] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15b90a54920f66a65e3f3d9d","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15b90a54920f66a65e3f3d9d: start","job_status":"start","queue_duration_s":0.427755,"scheduling_latency_s":0.42777} gitlab # [ 148.376565] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15b90a54920f66a65e3f3d9d","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15b90a54920f66a65e3f3d9d: done: 0.057793 sec","job_status":"done","queue_duration_s":0.427755,"scheduling_latency_s":0.42777,"redis_calls":13,"redis_duration_s":0.002619,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.057793,"completed_at":"2026-09-08T07:11:07.881Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.419266] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69711a8a262512bddc4eab13","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69711a8a262512bddc4eab13: start","job_status":"start","queue_duration_s":0.486734,"scheduling_latency_s":0.486753} gitlab # [ 148.419990] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69711a8a262512bddc4eab13","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69711a8a262512bddc4eab13: done: 0.010305 sec","job_status":"done","queue_duration_s":0.486734,"scheduling_latency_s":0.486753,"redis_calls":13,"redis_duration_s":0.002301,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001556,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010305,"completed_at":"2026-09-08T07:11:07.893Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.430699] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fcbee614a1b62111a2caeae","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fcbee614a1b62111a2caeae: start","job_status":"start","queue_duration_s":0.498055,"scheduling_latency_s":0.498069} gitlab # [ 148.474797] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fcbee614a1b62111a2caeae","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fcbee614a1b62111a2caeae: done: 0.009375 sec","job_status":"done","queue_duration_s":0.498055,"scheduling_latency_s":0.498069,"redis_calls":13,"redis_duration_s":0.0017469999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001135,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009375,"completed_at":"2026-09-08T07:11:07.903Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.475999] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71356a3988b34b4e48315f1e","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71356a3988b34b4e48315f1e: start","job_status":"start","queue_duration_s":0.508252,"scheduling_latency_s":0.508265} gitlab # [ 148.514559] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71356a3988b34b4e48315f1e","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71356a3988b34b4e48315f1e: done: 0.008977 sec","job_status":"done","queue_duration_s":0.508252,"scheduling_latency_s":0.508265,"redis_calls":13,"redis_duration_s":0.001415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008977,"completed_at":"2026-09-08T07:11:07.913Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.518667] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbce19e594a9b3878c11a7b2","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbce19e594a9b3878c11a7b2: start","job_status":"start","queue_duration_s":0.518026,"scheduling_latency_s":0.51804} gitlab # [ 148.565686] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbce19e594a9b3878c11a7b2","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbce19e594a9b3878c11a7b2: done: 0.009073 sec","job_status":"done","queue_duration_s":0.518026,"scheduling_latency_s":0.51804,"redis_calls":13,"redis_duration_s":0.001469,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009073,"completed_at":"2026-09-08T07:11:07.923Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.566477] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86bb37532cf2a203a261922b","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86bb37532cf2a203a261922b: start","job_status":"start","queue_duration_s":0.52799,"scheduling_latency_s":0.528003} gitlab # [ 148.573657] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86bb37532cf2a203a261922b","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86bb37532cf2a203a261922b: done: 0.012879 sec","job_status":"done","queue_duration_s":0.52799,"scheduling_latency_s":0.528003,"redis_calls":13,"redis_duration_s":0.0050880000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012879,"completed_at":"2026-09-08T07:11:07.937Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.625860] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4afc8e81e79524e98c15febf","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4afc8e81e79524e98c15febf: start","job_status":"start","queue_duration_s":0.541697,"scheduling_latency_s":0.541711} gitlab # [ 148.626563] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4afc8e81e79524e98c15febf","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4afc8e81e79524e98c15febf: done: 0.009239 sec","job_status":"done","queue_duration_s":0.541697,"scheduling_latency_s":0.541711,"redis_calls":13,"redis_duration_s":0.001661,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009239,"completed_at":"2026-09-08T07:11:07.947Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.664152] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd4a21303510252b40472e6a","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd4a21303510252b40472e6a: start","job_status":"start","queue_duration_s":0.552002,"scheduling_latency_s":0.552015} gitlab # [ 148.664895] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd4a21303510252b40472e6a","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd4a21303510252b40472e6a: done: 0.009082 sec","job_status":"done","queue_duration_s":0.552002,"scheduling_latency_s":0.552015,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009082,"completed_at":"2026-09-08T07:11:07.957Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.733245] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b12c0a88f7e1ae5f4dde74c","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b12c0a88f7e1ae5f4dde74c: start","job_status":"start","queue_duration_s":0.562272,"scheduling_latency_s":0.562286} gitlab # [ 148.733839] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b12c0a88f7e1ae5f4dde74c","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b12c0a88f7e1ae5f4dde74c: done: 0.009153 sec","job_status":"done","queue_duration_s":0.562272,"scheduling_latency_s":0.562286,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009153,"completed_at":"2026-09-08T07:11:07.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.772194] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de92b344e13eadea72123b91","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de92b344e13eadea72123b91: start","job_status":"start","queue_duration_s":0.57222,"scheduling_latency_s":0.572233} gitlab # [ 148.772989] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de92b344e13eadea72123b91","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de92b344e13eadea72123b91: done: 0.008952 sec","job_status":"done","queue_duration_s":0.57222,"scheduling_latency_s":0.572233,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008952,"completed_at":"2026-09-08T07:11:07.977Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.813273] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6352e64dd59f8e05a07a26d","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6352e64dd59f8e05a07a26d: start","job_status":"start","queue_duration_s":0.581962,"scheduling_latency_s":0.581974} gitlab # [ 148.814044] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6352e64dd59f8e05a07a26d","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6352e64dd59f8e05a07a26d: done: 0.009178 sec","job_status":"done","queue_duration_s":0.581962,"scheduling_latency_s":0.581974,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009178,"completed_at":"2026-09-08T07:11:07.987Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.830261] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"503d82c7f23a5c5c15dc9fda","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-503d82c7f23a5c5c15dc9fda: start","job_status":"start","queue_duration_s":0.591951,"scheduling_latency_s":0.591965} gitlab # [ 148.867897] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"503d82c7f23a5c5c15dc9fda","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-503d82c7f23a5c5c15dc9fda: done: 0.009173 sec","job_status":"done","queue_duration_s":0.591951,"scheduling_latency_s":0.591965,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009173,"completed_at":"2026-09-08T07:11:07.997Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.874576] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:07.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f63a7975c7d4b868ccd41709","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f63a7975c7d4b868ccd41709: start","job_status":"start","queue_duration_s":0.60193,"scheduling_latency_s":0.601944} gitlab # [ 148.912528] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f63a7975c7d4b868ccd41709","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f63a7975c7d4b868ccd41709: done: 0.00937 sec","job_status":"done","queue_duration_s":0.60193,"scheduling_latency_s":0.601944,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00937,"completed_at":"2026-09-08T07:11:08.007Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.918528] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6187c15b67ee3776ebfbb3a2","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6187c15b67ee3776ebfbb3a2: start","job_status":"start","queue_duration_s":0.612178,"scheduling_latency_s":0.61219} gitlab # [ 148.962785] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6187c15b67ee3776ebfbb3a2","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6187c15b67ee3776ebfbb3a2: done: 0.009036 sec","job_status":"done","queue_duration_s":0.612178,"scheduling_latency_s":0.61219,"redis_calls":13,"redis_duration_s":0.0014939999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009036,"completed_at":"2026-09-08T07:11:08.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.963867] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"007902409c2bc96a07c80d6b","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-007902409c2bc96a07c80d6b: start","job_status":"start","queue_duration_s":0.622013,"scheduling_latency_s":0.622028} gitlab # [ 148.973656] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"007902409c2bc96a07c80d6b","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-007902409c2bc96a07c80d6b: done: 0.009003 sec","job_status":"done","queue_duration_s":0.622013,"scheduling_latency_s":0.622028,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009003,"completed_at":"2026-09-08T07:11:08.027Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.017122] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a5a9e45f7e686d57b2c0726","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a5a9e45f7e686d57b2c0726: start","job_status":"start","queue_duration_s":0.631904,"scheduling_latency_s":0.631918} gitlab # [ 149.017840] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a5a9e45f7e686d57b2c0726","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a5a9e45f7e686d57b2c0726: done: 0.008865 sec","job_status":"done","queue_duration_s":0.631904,"scheduling_latency_s":0.631918,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008865,"completed_at":"2026-09-08T07:11:08.036Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.056196] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2919ae57cef0258d2639b4b1","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2919ae57cef0258d2639b4b1: start","job_status":"start","queue_duration_s":0.641897,"scheduling_latency_s":0.641912} gitlab # [ 149.097573] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2919ae57cef0258d2639b4b1","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2919ae57cef0258d2639b4b1: done: 0.009374 sec","job_status":"done","queue_duration_s":0.641897,"scheduling_latency_s":0.641912,"redis_calls":13,"redis_duration_s":0.0018089999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009374,"completed_at":"2026-09-08T07:11:08.047Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.098536] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39eac194d70782aaa614de31","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39eac194d70782aaa614de31: start","job_status":"start","queue_duration_s":0.652086,"scheduling_latency_s":0.652099} gitlab # [ 149.105735] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39eac194d70782aaa614de31","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39eac194d70782aaa614de31: done: 0.008933 sec","job_status":"done","queue_duration_s":0.652086,"scheduling_latency_s":0.652099,"redis_calls":13,"redis_duration_s":0.001788,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001309,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008933,"completed_at":"2026-09-08T07:11:08.057Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.147530] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfd1ddd42fa36de0c773c0cd","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfd1ddd42fa36de0c773c0cd: start","job_status":"start","queue_duration_s":0.661816,"scheduling_latency_s":0.661829} gitlab # [ 149.151047] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfd1ddd42fa36de0c773c0cd","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfd1ddd42fa36de0c773c0cd: done: 0.008827 sec","job_status":"done","queue_duration_s":0.661816,"scheduling_latency_s":0.661829,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008827,"completed_at":"2026-09-08T07:11:08.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.191133] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c184d17cf71093549529505e","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c184d17cf71093549529505e: start","job_status":"start","queue_duration_s":0.671429,"scheduling_latency_s":0.671442} gitlab # [ 149.195089] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c184d17cf71093549529505e","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c184d17cf71093549529505e: done: 0.00883 sec","job_status":"done","queue_duration_s":0.671429,"scheduling_latency_s":0.671442,"redis_calls":13,"redis_duration_s":0.001417,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00883,"completed_at":"2026-09-08T07:11:08.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.234084] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df749736d14d184492c5f172","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df749736d14d184492c5f172: start","job_status":"start","queue_duration_s":0.681351,"scheduling_latency_s":0.681365} gitlab # [ 149.239146] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df749736d14d184492c5f172","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df749736d14d184492c5f172: done: 0.008988 sec","job_status":"done","queue_duration_s":0.681351,"scheduling_latency_s":0.681365,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008988,"completed_at":"2026-09-08T07:11:08.086Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.278222] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12556cdeab76950396684c6c","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12556cdeab76950396684c6c: start","job_status":"start","queue_duration_s":0.691212,"scheduling_latency_s":0.691226} gitlab # [ 149.315514] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12556cdeab76950396684c6c","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12556cdeab76950396684c6c: done: 0.009061 sec","job_status":"done","queue_duration_s":0.691212,"scheduling_latency_s":0.691226,"redis_calls":13,"redis_duration_s":0.0015320000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009061,"completed_at":"2026-09-08T07:11:08.096Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.316509] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15bec2fbc765a97a80fe45c0","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15bec2fbc765a97a80fe45c0: start","job_status":"start","queue_duration_s":0.701079,"scheduling_latency_s":0.701092} gitlab # [ 149.355657] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15bec2fbc765a97a80fe45c0","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15bec2fbc765a97a80fe45c0: done: 0.008981 sec","job_status":"done","queue_duration_s":0.701079,"scheduling_latency_s":0.701092,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008981,"completed_at":"2026-09-08T07:11:08.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.360182] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20805cb4c303a307d3c4c4e1","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20805cb4c303a307d3c4c4e1: start","job_status":"start","queue_duration_s":0.710875,"scheduling_latency_s":0.71089} gitlab # [ 149.371101] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20805cb4c303a307d3c4c4e1","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20805cb4c303a307d3c4c4e1: done: 0.012513 sec","job_status":"done","queue_duration_s":0.710875,"scheduling_latency_s":0.71089,"redis_calls":13,"redis_duration_s":0.001944,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001408,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012513,"completed_at":"2026-09-08T07:11:08.119Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.417033] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3daf3e282b5c1725ad21a98","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3daf3e282b5c1725ad21a98: start","job_status":"start","queue_duration_s":0.724525,"scheduling_latency_s":0.72456} gitlab # [ 149.417688] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3daf3e282b5c1725ad21a98","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3daf3e282b5c1725ad21a98: done: 0.010694 sec","job_status":"done","queue_duration_s":0.724525,"scheduling_latency_s":0.72456,"redis_calls":13,"redis_duration_s":0.001548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010694,"completed_at":"2026-09-08T07:11:08.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.458182] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bc62d42cf9dd190b576e1a1","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bc62d42cf9dd190b576e1a1: start","job_status":"start","queue_duration_s":0.736044,"scheduling_latency_s":0.736058} gitlab # [ 149.459227] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bc62d42cf9dd190b576e1a1","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bc62d42cf9dd190b576e1a1: done: 0.009669 sec","job_status":"done","queue_duration_s":0.736044,"scheduling_latency_s":0.736058,"redis_calls":13,"redis_duration_s":0.0014650000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009669,"completed_at":"2026-09-08T07:11:08.141Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.528672] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522c635a49e299ebaf6a9879","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522c635a49e299ebaf6a9879: start","job_status":"start","queue_duration_s":0.746507,"scheduling_latency_s":0.74652} gitlab # [ 149.529509] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522c635a49e299ebaf6a9879","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522c635a49e299ebaf6a9879: done: 0.009938 sec","job_status":"done","queue_duration_s":0.746507,"scheduling_latency_s":0.74652,"redis_calls":13,"redis_duration_s":0.001553,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009938,"completed_at":"2026-09-08T07:11:08.152Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.537695] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"981b82b90c8308e08efc585c","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-981b82b90c8308e08efc585c: start","job_status":"start","queue_duration_s":0.757903,"scheduling_latency_s":0.757916} gitlab # [ 149.548636] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"981b82b90c8308e08efc585c","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-981b82b90c8308e08efc585c: done: 0.009803 sec","job_status":"done","queue_duration_s":0.757903,"scheduling_latency_s":0.757916,"redis_calls":13,"redis_duration_s":0.001501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009803,"completed_at":"2026-09-08T07:11:08.163Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.592028] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5511f19d1baff572a417397e","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5511f19d1baff572a417397e: start","job_status":"start","queue_duration_s":0.7685,"scheduling_latency_s":0.768513} gitlab # [ 149.592666] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5511f19d1baff572a417397e","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5511f19d1baff572a417397e: done: 0.00947 sec","job_status":"done","queue_duration_s":0.7685,"scheduling_latency_s":0.768513,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00947,"completed_at":"2026-09-08T07:11:08.174Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.648826] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"305945185fa625d7d0a7aed3","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-305945185fa625d7d0a7aed3: start","job_status":"start","queue_duration_s":0.778794,"scheduling_latency_s":0.778807} gitlab # [ 149.649589] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"305945185fa625d7d0a7aed3","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-305945185fa625d7d0a7aed3: done: 0.009439 sec","job_status":"done","queue_duration_s":0.778794,"scheduling_latency_s":0.778807,"redis_calls":13,"redis_duration_s":0.0014919999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009439,"completed_at":"2026-09-08T07:11:08.184Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.690631] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"051c6932bac61dd0fad92ba6","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-051c6932bac61dd0fad92ba6: start","job_status":"start","queue_duration_s":0.789196,"scheduling_latency_s":0.78921} gitlab # [ 149.691446] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"051c6932bac61dd0fad92ba6","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-051c6932bac61dd0fad92ba6: done: 0.009656 sec","job_status":"done","queue_duration_s":0.789196,"scheduling_latency_s":0.78921,"redis_calls":13,"redis_duration_s":0.0015599999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009656,"completed_at":"2026-09-08T07:11:08.195Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.744967] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33c3d8fd9e58f34a1580f298","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33c3d8fd9e58f34a1580f298: start","job_status":"start","queue_duration_s":0.800083,"scheduling_latency_s":0.800097} gitlab # [ 149.745637] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33c3d8fd9e58f34a1580f298","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33c3d8fd9e58f34a1580f298: done: 0.009529 sec","job_status":"done","queue_duration_s":0.800083,"scheduling_latency_s":0.800097,"redis_calls":13,"redis_duration_s":0.0014839999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009529,"completed_at":"2026-09-08T07:11:08.205Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.759227] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0ee3276f4d83e451c0c96b1","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0ee3276f4d83e451c0c96b1: start","job_status":"start","queue_duration_s":0.81043,"scheduling_latency_s":0.810444} gitlab # [ 149.798599] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0ee3276f4d83e451c0c96b1","created_at":"2026-09-08T07:11:07.343Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e36a08e9366d4376","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a551375dff3ea57fe0c25f8c9ea2ac88","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.396Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0ee3276f4d83e451c0c96b1: done: 0.009601 sec","job_status":"done","queue_duration_s":0.81043,"scheduling_latency_s":0.810444,"redis_calls":13,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009601,"completed_at":"2026-09-08T07:11:08.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.803108] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"29f58e9665f46966ae8fe6bb","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-29f58e9665f46966ae8fe6bb: start","job_status":"start","queue_duration_s":0.76367,"scheduling_latency_s":0.763683} gitlab # [ 149.848120] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"29f58e9665f46966ae8fe6bb","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-29f58e9665f46966ae8fe6bb: done: 0.029069 sec","job_status":"done","queue_duration_s":0.76367,"scheduling_latency_s":0.763683,"redis_calls":16,"redis_duration_s":0.0021030000000000003,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000349,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210921,"duration_s":0.029069,"completed_at":"2026-09-08T07:11:08.246Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006556,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.849543] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9f6f6b6d2729660a8d20f34f","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9f6f6b6d2729660a8d20f34f: start","job_status":"start","queue_duration_s":0.793793,"scheduling_latency_s":0.793809} gitlab # [ 149.860981] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9f6f6b6d2729660a8d20f34f","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9f6f6b6d2729660a8d20f34f: done: 0.009979 sec","job_status":"done","queue_duration_s":0.793793,"scheduling_latency_s":0.793809,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009979,"completed_at":"2026-09-08T07:11:08.257Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000562,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.919742] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"776a88b3e632320f580e2b4e","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-776a88b3e632320f580e2b4e: start","job_status":"start","queue_duration_s":0.804547,"scheduling_latency_s":0.80456} gitlab # [ 149.920706] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"776a88b3e632320f580e2b4e","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-776a88b3e632320f580e2b4e: done: 0.011913 sec","job_status":"done","queue_duration_s":0.804547,"scheduling_latency_s":0.80456,"redis_calls":13,"redis_duration_s":0.00161,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011913,"completed_at":"2026-09-08T07:11:08.269Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.959944] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1bebf5e0f110e3c3a14975f4","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1bebf5e0f110e3c3a14975f4: start","job_status":"start","queue_duration_s":0.81763,"scheduling_latency_s":0.817648} gitlab # [ 149.960681] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1bebf5e0f110e3c3a14975f4","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1bebf5e0f110e3c3a14975f4: done: 0.011739 sec","job_status":"done","queue_duration_s":0.81763,"scheduling_latency_s":0.817648,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001076,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011739,"completed_at":"2026-09-08T07:11:08.282Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000585,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.998963] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9a69f2f26359f03c132a8e28","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9a69f2f26359f03c132a8e28: start","job_status":"start","queue_duration_s":0.830195,"scheduling_latency_s":0.830211} gitlab # [ 149.999595] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9a69f2f26359f03c132a8e28","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9a69f2f26359f03c132a8e28: done: 0.01006 sec","job_status":"done","queue_duration_s":0.830195,"scheduling_latency_s":0.830211,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01006,"completed_at":"2026-09-08T07:11:08.293Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000475,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.048213] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"247eec6b100f35b327be044b","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-247eec6b100f35b327be044b: start","job_status":"start","queue_duration_s":0.841076,"scheduling_latency_s":0.841089} gitlab # [ 150.048888] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"247eec6b100f35b327be044b","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-247eec6b100f35b327be044b: done: 0.009893 sec","job_status":"done","queue_duration_s":0.841076,"scheduling_latency_s":0.841089,"redis_calls":13,"redis_duration_s":0.0014559999999999998,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009893,"completed_at":"2026-09-08T07:11:08.304Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.088038] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"24313732f03bb3b4ea02d928","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-24313732f03bb3b4ea02d928: start","job_status":"start","queue_duration_s":0.851803,"scheduling_latency_s":0.851817} gitlab # [ 150.088773] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"24313732f03bb3b4ea02d928","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-24313732f03bb3b4ea02d928: done: 0.009628 sec","job_status":"done","queue_duration_s":0.851803,"scheduling_latency_s":0.851817,"redis_calls":13,"redis_duration_s":0.001527,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009628,"completed_at":"2026-09-08T07:11:08.314Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.135099] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c897823bf980c236362853ce","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c897823bf980c236362853ce: start","job_status":"start","queue_duration_s":0.862488,"scheduling_latency_s":0.862502} gitlab # [ 150.135777] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c897823bf980c236362853ce","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c897823bf980c236362853ce: done: 0.009761 sec","job_status":"done","queue_duration_s":0.862488,"scheduling_latency_s":0.862502,"redis_calls":13,"redis_duration_s":0.001468,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009761,"completed_at":"2026-09-08T07:11:08.325Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000359,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.201684] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"6b1db07113cd81b220b1bcbc","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-6b1db07113cd81b220b1bcbc: start","job_status":"start","queue_duration_s":0.873179,"scheduling_latency_s":0.873196} gitlab # [ 150.202591] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"6b1db07113cd81b220b1bcbc","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-6b1db07113cd81b220b1bcbc: done: 0.009891 sec","job_status":"done","queue_duration_s":0.873179,"scheduling_latency_s":0.873196,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000469,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009891,"completed_at":"2026-09-08T07:11:08.336Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.239716] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"cb1daa307e37781fd6e03030","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-cb1daa307e37781fd6e03030: start","job_status":"start","queue_duration_s":0.883901,"scheduling_latency_s":0.883914} gitlab # [ 150.240459] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:08.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"cb1daa307e37781fd6e03030","created_at":"2026-09-08T07:11:07.439Z","trace_propagation_headers":{"sentry-trace":"77c2c142dc12470f8d6a7f8e91d9e3cf-e2823d89772f43b2","baggage":"sentry-trace_id=77c2c142dc12470f8d6a7f8e91d9e3cf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a69f111d7a7ea4a9b6f086329c5bcc63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:07.453Z","job_size_bytes":2,"pid":1628,"sidekiq_tid":"maes","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-cb1daa307e37781fd6e03030: done: 0.010071 sec","job_status":"done","queue_duration_s":0.883901,"scheduling_latency_s":0.883914,"redis_calls":13,"redis_duration_s":0.001728,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010071,"completed_at":"2026-09-08T07:11:08.347Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.442350] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2018197431 wd_nsec: 2018197328 gitlab # [ 162.103283] setup-gitlab-start[2228]: W, [2026-09-08T07:11:22.428161 #2228] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 183.349117] postgres[2430]: [2430] ERROR: relation "table_without_models" does not exist gitlab # [ 183.350570] postgres[2430]: [2430] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 186.219938] runuser[2224]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 186.222715] setup-gitlab-start[2199]: + systemctl restart gitlab-sidekiq.service gitlab # [ 186.246796] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 186.249517] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:46.572Z","message":"Shutting down"} gitlab # [ 186.252769] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:46.572Z","message":"Scheduler exiting..."} gitlab # [ 186.256112] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:46.572Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 186.259942] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:46.572Z","message":"Scheduler exiting..."} gitlab # [ 186.748426] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:47.073Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 188.752301] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:49.077Z","message":"Bye!"} gitlab # [ 188.782762] sidekiq-cluster[1628]: {"severity":"INFO","time":"2026-09-08T07:11:49.108Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1628,"worker_id":"sidekiq_0","memwd_rss_bytes":942575616,"retry":0} gitlab # [ 189.819848] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 189.821603] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 189.823746] systemd[1]: gitlab-sidekiq.service: Consumed 56.987s CPU time over 1min 56.094s wall clock time, 955.7M memory peak, 4.4M read from disk. gitlab # [ 189.828702] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 189.832151] setup-gitlab-start[2199]: + mkdir -p /var/lib/secrets gitlab # [ 189.835575] setup-gitlab-start[2199]: + echo nixbot-test-token-of-20-chars gitlab # [ 189.837237] setup-gitlab-start[2199]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 189.839597] setup-gitlab-start[2199]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars gitlab # [ 190.281898] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:11:50 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 416 gitlab # [ 190.810981] gitaly[913]: time="2026-09-08T07:11:51.135Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T07:12:01.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.135" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 190.812225] gitaly[913]: time="2026-09-08T07:11:51.135Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T07:12:01.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.135" grpc.time_ms=0.485 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 190.939859] gitaly[913]: time="2026-09-08T07:11:51.265Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T07:12:01.134" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.265" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 190.961697] gitaly[913]: time="2026-09-08T07:11:51.287Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T07:12:01.134" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.265" grpc.time_ms=0.395 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.021055] gitaly[913]: time="2026-09-08T07:11:51.346Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS diskcache=214ff475-7a16-452e-a16e-2c8b133c6b88 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-08T07:12:01.161" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.292" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.041681] gitaly[913]: time="2026-09-08T07:11:51.347Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1580 command.oublock=32 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=16 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-08T07:12:01.161" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.292" grpc.time_ms=54.178 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.043101] gitaly[913]: time="2026-09-08T07:11:51.363Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T07:12:01.232" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.363" pid=913 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 191.045614] gitaly[913]: time="2026-09-08T07:11:51.364Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T07:12:01.232" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.363" grpc.time_ms=0.799 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.054672] gitaly[913]: time="2026-09-08T07:11:51.380Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T07:12:01.238" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.369" grpc.time_ms=10.634 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.107102] gitaly[913]: time="2026-09-08T07:11:51.432Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T07:12:01.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.432" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.108233] gitaly[913]: time="2026-09-08T07:11:51.432Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T07:12:01.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.432" grpc.time_ms=0.317 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.163849] gitaly[913]: time="2026-09-08T07:11:51.489Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS diskcache=5abf1bbb-8130-49c7-9fb3-7ce920a7ebb8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-08T07:12:01.003" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.434" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.165106] gitaly[913]: time="2026-09-08T07:11:51.489Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1583 command.oublock=32 command.real_time_ms=29 command.spawn_token_fork_ms=11 command.system_time_ms=14 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-08T07:12:01.003" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.434" grpc.time_ms=55.178 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.194565] gitaly[913]: time="2026-09-08T07:11:51.520Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T07:12:01.089" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.519" pid=913 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 191.195676] gitaly[913]: time="2026-09-08T07:11:51.520Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T07:12:01.089" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.519" grpc.time_ms=0.379 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.224577] gitaly[913]: time="2026-09-08T07:11:51.550Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T07:12:01.109" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.539" grpc.time_ms=10.066 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.265167] gitaly[913]: time="2026-09-08T07:11:51.590Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T07:12:01.160" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.590" grpc.time_ms=0.131 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.276067] gitaly[913]: time="2026-09-08T07:11:51.601Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-08T07:12:01.169" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:51.599" grpc.time_ms=1.437 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.769749] gitaly[913]: time="2026-09-08T07:11:52.095Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQQAZ7WEYC1MEFCY59BDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T07:12:02.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:52.089" grpc.time_ms=5.837 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.128466] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:11:52 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 1829 gitlab # [ 192.132975] setup-gitlab-start[2486]: {"id":1,"message":null,"error":null} gitlab # [ 192.879292] sidekiq-cluster[2473]: {"severity":"INFO","time":"2026-09-08T07:11:53.187Z","message":"Starting cluster with 1 processes"} gitlab # [ 197.255550] gitaly[913]: time="2026-09-08T07:11:57.580Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQY18N10J0Y5864Z0CM94 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T07:12:07.138" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:57.569" grpc.time_ms=11.097 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.326643] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:11:57 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 170 gitlab # [ 197.335566] setup-gitlab-start[2199]: + mkdir -p /tmp/test-flake gitlab # [ 197.338596] setup-gitlab-start[2199]: + cd /tmp/test-flake gitlab # [ 197.344228] setup-gitlab-start[2199]: + git init -b master gitlab # [ 197.358258] setup-gitlab-start[2560]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 197.360180] setup-gitlab-start[2199]: + git config user.name test gitlab # [ 197.367380] setup-gitlab-start[2199]: + git config user.email test@example.com gitlab # [ 197.373900] setup-gitlab-start[2199]: + cat gitlab # [ 197.378753] setup-gitlab-start[2199]: + git add flake.nix gitlab # [ 197.385895] setup-gitlab-start[2199]: + git commit -m 'initial commit' gitlab # [ 197.408370] setup-gitlab-start[2565]: [master (root-commit) c210e88] initial commit gitlab # [ 197.410866] setup-gitlab-start[2565]: 1 file changed, 10 insertions(+) gitlab # [ 197.411494] setup-gitlab-start[2565]: create mode 100644 flake.nix gitlab # [ 197.411918] setup-gitlab-start[2199]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 197.418446] setup-gitlab-start[2199]: + git push -u origin master gitlab # [ 197.472522] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:11:57 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 29 gitlab # [ 197.577738] gitaly[913]: time="2026-09-08T07:11:57.903Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYB76900TCJ88HVV0A6M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:11:57.889" grpc.time_ms=13.537 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 197.579868] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:11:57 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 105 gitlab # [ 197.804686] gitaly[913]: time="2026-09-08T07:11:58.130Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T07:12:08.038" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:58.119" grpc.time_ms=10.81 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.864798] gitaly[913]: time="2026-09-08T07:11:58.190Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=333 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-08T07:12:28.081" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-08T07:11:58.182" grpc.time_ms=7.721 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.911465] gitaly[913]: time="2026-09-08T07:11:58.237Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K duration_ms=167ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 197.939677] gitaly[913]: time="2026-09-08T07:11:58.265Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K duration_ms=21ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 197.946375] gitaly[913]: time="2026-09-08T07:11:58.272Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:11:58.068" grpc.time_ms=203.456 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.001452] gitaly[913]: time="2026-09-08T07:11:58.327Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:11:58.326" grpc.time_ms=0.559 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.041662] gitaly[913]: time="2026-09-08T07:11:58.367Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:11:58.367" grpc.time_ms=0.304 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.071611] gitaly[913]: time="2026-09-08T07:11:58.397Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:11:58.396" grpc.time_ms=0.588 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.267044] gitaly[913]: time="2026-09-08T07:11:58.592Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T07:12:08.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:11:58.582" grpc.time_ms=9.56 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.343562] gitaly[913]: time="2026-09-08T07:11:58.669Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1560 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-08T07:12:08.062" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:11:58.643" grpc.time_ms=25.513 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 198.385937] gitaly[913]: time="2026-09-08T07:11:58.711Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K duration_ms=287ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 198.392964] gitaly[913]: time="2026-09-08T07:11:58.718Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:11:58.423" grpc.time_ms=295.106 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.423246] gitaly[913]: time="2026-09-08T07:11:58.748Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K diskcache=58c26e50-a750-4370-8f2a-9189637c3136 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:11:57.995" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.423954] gitaly[913]: time="2026-09-08T07:11:58.749Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=170 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13475 command.oublock=32 command.real_time_ms=743 command.spawn_token_fork_ms=2 command.system_time_ms=110 command.user_time_ms=60 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:11:57.995" grpc.time_ms=753.813 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 198.424843] gitlab-workhorse[827]: time="2026-09-08T07:11:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 198.425620] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:11:58 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 807 gitlab # [ 198.447913] setup-gitlab-start[2569]: To http://gitlab/root/test-flake.git gitlab # [ 198.448616] setup-gitlab-start[2569]: * [new branch] master -> master gitlab # [ 198.453120] setup-gitlab-start[2569]: branch 'master' set up to track 'origin/master'. gitlab # [ 198.455956] systemd[1]: Finished setup-gitlab.service. gitlab # [ 198.458577] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 199.76 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 199.570525] nixbot[2656]: {"ts": "2026-09-08T07:11:59.895Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 199.602742] nixbot[2656]: {"ts": "2026-09-08T07:11:59.928Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 199.634439] nixbot[2656]: {"ts": "2026-09-08T07:11:59.960Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 199.644563] nixbot[2656]: {"ts": "2026-09-08T07:11:59.970Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 199.655303] nixbot[2656]: {"ts": "2026-09-08T07:11:59.980Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 199.668811] nixbot[2656]: {"ts": "2026-09-08T07:11:59.994Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 199.679226] nixbot[2656]: {"ts": "2026-09-08T07:12:00.004Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 199.684387] nixbot[2656]: {"ts": "2026-09-08T07:12:00.007Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 199.691070] nixbot[2656]: {"ts": "2026-09-08T07:12:00.016Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 199.698964] nixbot[2656]: {"ts": "2026-09-08T07:12:00.024Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 199.710796] nixbot[2656]: {"ts": "2026-09-08T07:12:00.036Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 199.724533] nixbot[2656]: {"ts": "2026-09-08T07:12:00.050Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 199.729719] nixbot[2656]: {"ts": "2026-09-08T07:12:00.055Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 199.737826] nixbot[2656]: {"ts": "2026-09-08T07:12:00.063Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 199.743261] nixbot[2656]: {"ts": "2026-09-08T07:12:00.068Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 199.751079] nixbot[2656]: {"ts": "2026-09-08T07:12:00.076Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 199.758871] nixbot[2656]: {"ts": "2026-09-08T07:12:00.084Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 199.765644] nixbot[2656]: {"ts": "2026-09-08T07:12:00.091Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 199.774583] nixbot[2656]: {"ts": "2026-09-08T07:12:00.100Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 199.780612] nixbot[2656]: {"ts": "2026-09-08T07:12:00.106Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 199.787504] nixbot[2656]: {"ts": "2026-09-08T07:12:00.113Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 199.798878] nixbot[2656]: {"ts": "2026-09-08T07:12:00.124Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 199.805693] nixbot[2656]: {"ts": "2026-09-08T07:12:00.131Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 199.813150] nixbot[2656]: {"ts": "2026-09-08T07:12:00.138Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 199.816248] nixbot[2656]: {"ts": "2026-09-08T07:12:00.141Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 199.824827] nixbot[2656]: {"ts": "2026-09-08T07:12:00.150Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"} gitlab # [ 199.828118] nixbot[2656]: {"ts": "2026-09-08T07:12:00.153Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"} gitlab # [ 199.830987] nixbot[2656]: {"ts": "2026-09-08T07:12:00.156Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"} gitlab # [ 199.834137] nixbot[2656]: {"ts": "2026-09-08T07:12:00.159Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"} gitlab # [ 199.851411] nixbot[2656]: {"ts": "2026-09-08T07:12:00.176Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"} gitlab # [ 199.861068] nixbot[2656]: {"ts": "2026-09-08T07:12:00.186Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"} gitlab # [ 199.868140] nixbot[2656]: {"ts": "2026-09-08T07:12:00.193Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"} gitlab # [ 199.871345] nixbot[2656]: {"ts": "2026-09-08T07:12:00.196Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"} gitlab # [ 200.288243] nixbot[2656]: INFO: Started server process [2656] gitlab # [ 200.290299] nixbot[2656]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 200.308848] nixbot[2656]: INFO: ::ffff:127.0.0.1:57068 - "GET /health HTTP/1.1" 200 OK gitlab # [ 200.314490] systemd[1]: Started nixbot CI service. gitlab # [ 200.321944] systemd[1]: Reached target Multi-User System. gitlab # [ 200.324162] systemd[1]: Startup finished in 1.225s (kernel) + 3.485s (initrd) + 3min 15.613s (userspace) = 3min 20.323s. gitlab # [ 201.029865] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:01 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 722 gitlab # [ 201.035935] nixbot[2656]: {"ts": "2026-09-08T07:12:01.356Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 201.047209] nixbot[2656]: {"ts": "2026-09-08T07:12:01.372Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 201.126828] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 71 gitlab # [ 201.131812] nixbot[2656]: {"ts": "2026-09-08T07:12:01.453Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 201.136913] nixbot[2656]: {"ts": "2026-09-08T07:12:01.456Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 201.229680] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 94 gitlab: (finished: waiting for unit nixbot.service, in 2.10 seconds) gitlab # [ 201.235173] nixbot[2656]: {"ts": "2026-09-08T07:12:01.556Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 201.274768] nixbot[2656]: INFO: ::ffff:127.0.0.1:57074 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 201.323591] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:01 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 84 gitlab # [ 201.327921] nixbot[2656]: {"ts": "2026-09-08T07:12:01.650Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 201.370123] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 35 gitlab # [ 201.374924] nixbot[2656]: {"ts": "2026-09-08T07:12:01.695Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 201.398655] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 85 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds) (finished: subtest: project discovered and webhook registered, in 0.12 seconds) subtest: push delivers the webhook gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails' gitlab # [ 201.419970] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:01 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 38 gitlab # [ 201.420789] nixbot[2656]: {"ts": "2026-09-08T07:12:01.746Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 201.468053] gitaly[913]: time="2026-09-08T07:12:01.792Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR26N1BXT5Q8KYYZ034GT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-08T07:12:31.083" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:01.784" grpc.time_ms=8.196 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.497342] gitaly[913]: time="2026-09-08T07:12:01.822Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR26N1BXT5Q8KYYZ034GT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:12:31.121" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:01.822" grpc.time_ms=0.64 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.515323] gitaly[913]: time="2026-09-08T07:12:01.841Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR26N1BXT5Q8KYYZ034GT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-08T07:12:11.255" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:01.835" grpc.time_ms=4.884 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.548434] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 124 gitlab # [ 201.549664] nixbot[2656]: {"ts": "2026-09-08T07:12:01.874Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 201.624762] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 68 gitlab # [ 201.625572] nixbot[2656]: {"ts": "2026-09-08T07:12:01.949Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 201.638441] nixbot[2656]: {"ts": "2026-09-08T07:12:01.964Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 201.745167] gitaly[913]: time="2026-09-08T07:12:02.070Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXR2EGPN50RJ6K8YXJDET3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.058" grpc.time_ms=12.173 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.776423] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 99 gitlab # [ 201.955333] gitaly[913]: time="2026-09-08T07:12:02.280Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR2HRPGG1QZ6FVXW5V1M6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.268" pid=913 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 201.956589] gitaly[913]: time="2026-09-08T07:12:02.281Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR2HRPGG1QZ6FVXW5V1M6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.268" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.004601] gitaly[913]: time="2026-09-08T07:12:02.330Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR2HRPGG1QZ6FVXW5V1M6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.268" grpc.time_ms=61.817 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.025757] gitlab-workhorse[827]: time="2026-09-08T07:12:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 202.026506] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 247 gitlab # [ 202.140155] gitaly[913]: time="2026-09-08T07:12:02.465Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR2SQNRTJ3N4WSNC911EY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.444" pid=913 remote_ip="2001:db8:1::1" request_sha=1b934f401ea0aa8fcbf97a2c6f75fedfbca7d9d5 response_bytes=223 span.kind=server system=grpc gitlab # [ 202.162637] gitaly[913]: time="2026-09-08T07:12:02.465Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR2SQNRTJ3N4WSNC911EY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.444" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.189089] gitaly[913]: time="2026-09-08T07:12:02.488Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR2SQNRTJ3N4WSNC911EY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.444" grpc.time_ms=21.672 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.204516] gitlab-workhorse[827]: time="2026-09-08T07:12:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=223 gitlab # [ 202.206367] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 128 gitlab # [ 202.302593] gitaly[913]: time="2026-09-08T07:12:02.628Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXR304FAXB0585VM7THDXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.621" grpc.time_ms=6.183 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.331177] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 91 gitlab # [ 202.382204] gitaly[913]: time="2026-09-08T07:12:02.707Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR333MQWSDS78AP1QVXS2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.696" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 202.383090] gitaly[913]: time="2026-09-08T07:12:02.708Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR333MQWSDS78AP1QVXS2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.696" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.383727] gitaly[913]: time="2026-09-08T07:12:02.708Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR333MQWSDS78AP1QVXS2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.696" grpc.time_ms=11.574 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.384874] gitlab-workhorse[827]: time="2026-09-08T07:12:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 202.386354] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 50 gitlab # [ 202.530508] gitaly[913]: time="2026-09-08T07:12:02.855Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXR37YXFSKZT1NWGFFMPYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.848" grpc.time_ms=6.256 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.555384] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 41 gitlab # [ 202.615478] gitaly[913]: time="2026-09-08T07:12:02.941Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR3A5AZYDH3WXPMVSWMFX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.921" pid=913 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 202.620548] gitaly[913]: time="2026-09-08T07:12:02.941Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR3A5AZYDH3WXPMVSWMFX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.921" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.621650] gitlab-workhorse[827]: time="2026-09-08T07:12:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 202.622701] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 56 gitlab # [ 202.624273] gitaly[913]: time="2026-09-08T07:12:02.941Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR3A5AZYDH3WXPMVSWMFX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:02.921" grpc.time_ms=19.899 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 202.753107] gitaly[913]: time="2026-09-08T07:12:03.078Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:12:33.077" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:03.077" grpc.time_ms=0.864 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 202.812809] gitaly[913]: time="2026-09-08T07:12:03.138Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-08T07:12:33.029" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:03.130" grpc.time_ms=7.831 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 202.829623] gitaly[913]: time="2026-09-08T07:12:03.155Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:13.018" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:03.149" grpc.time_ms=5.897 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 202.876995] gitaly[913]: time="2026-09-08T07:12:03.202Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:13.061" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:03.192" grpc.time_ms=10.363 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 202.951705] gitaly[913]: time="2026-09-08T07:12:03.277Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-08T07:12:13.146" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:12:03.276" grpc.time_ms=0.365 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 202.975571] gitaly[913]: time="2026-09-08T07:12:03.292Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-08T07:12:13.154" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:03.285" grpc.time_ms=7.051 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 203.026161] gitaly[913]: time="2026-09-08T07:12:03.351Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:03.350" grpc.time_ms=1.486 pid=913 span.kind=server system=grpc gitlab # [ 203.057439] gitaly[913]: time="2026-09-08T07:12:03.382Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:03.382" grpc.time_ms=0.331 pid=913 span.kind=server system=grpc gitlab # [ 203.077104] gitaly[913]: time="2026-09-08T07:12:03.402Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 diskcache=d9d22819-ad2d-4e1c-9f16-6854b7a3bec5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T07:12:13.164" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:12:03.294" pid=913 ref=refs/keep-around/c210e880bc7e1858923395a18a5aad313ef0848a remote_ip="2001:db8:1::1" revision=c210e880bc7e1858923395a18a5aad313ef0848a span.kind=server system=grpc username=root gitlab # [ 203.087639] gitaly[913]: time="2026-09-08T07:12:03.403Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=63 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5401 command.oublock=8 command.real_time_ms=99 command.spawn_token_fork_ms=0 command.system_time_ms=38 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T07:12:13.164" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:12:03.294" grpc.time_ms=107.995 pid=913 ref=refs/keep-around/c210e880bc7e1858923395a18a5aad313ef0848a remote_ip="2001:db8:1::1" revision=c210e880bc7e1858923395a18a5aad313ef0848a span.kind=server system=grpc username=root gitlab # [ 203.088588] gitaly[913]: time="2026-09-08T07:12:03.407Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:12:33.306" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:03.407" grpc.time_ms=0.374 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 203.213296] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:03 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 507 gitlab # [ 203.220173] nixbot[2656]: {"ts": "2026-09-08T07:12:03.545Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a \"HTTP/1.1 201 Created\""} gitlab # [ 203.237208] nixbot[2656]: {"ts": "2026-09-08T07:12:03.562Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-c210e880bc7e-0"} gitlab # [ 203.420932] nixbot[2656]: {"ts": "2026-09-08T07:12:03.746Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-c210e880bc7e-0", "argv0": "bwrap"} gitlab # [ 203.517875] systemd[1]: Started Nix Daemon. gitlab # [ 203.575954] nix-daemon[2821]: accepted connection from pid 2809, user nixbot gitlab # [ 208.322324] nix-daemon[2821]: accepted connection from pid 2863, user nixbot gitlab # [ 208.335643] nix-daemon[2821]: accepted connection from pid 2809, user nixbot gitlab # [ 212.508634] nix-daemon[2821]: accepted connection from pid 2809, user nixbot gitlab # [ 212.600332] nix-daemon[2821]: accepted connection from pid 2906, user nixbot gitlab # [ 212.637633] gitaly[913]: time="2026-09-08T07:12:12.962Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXRD3H4ZXCSWBH1KFDNZYB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:12:42.860" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:12.961" grpc.time_ms=0.782 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.717689] gitaly[913]: time="2026-09-08T07:12:13.043Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXRD3H4ZXCSWBH1KFDNZYB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:23.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:13.030" grpc.time_ms=12.739 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.755241] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 167 gitlab # [ 212.761489] nixbot[2656]: {"ts": "2026-09-08T07:12:13.082Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a \"HTTP/1.1 201 Created\""} gitlab # [ 212.796612] gitaly[913]: time="2026-09-08T07:12:13.122Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXRD8XZ97505HKJ38SE6WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:12:43.020" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:13.121" grpc.time_ms=0.838 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.850833] gitaly[913]: time="2026-09-08T07:12:13.176Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXRD8XZ97505HKJ38SE6WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:23.147" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:13.168" grpc.time_ms=7.868 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.883972] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 124 gitlab # [ 212.886512] nixbot[2656]: {"ts": "2026-09-08T07:12:13.210Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a \"HTTP/1.1 201 Created\""} gitlab # [ 217.274303] nix-daemon[2821]: accepted connection from pid 2980, user nixbot gitlab # [ 217.358998] gitaly[913]: time="2026-09-08T07:12:17.684Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXRHPVDDBN3JWGSPEBCTE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:12:47.583" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:17.683" grpc.time_ms=0.457 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 217.412741] gitaly[913]: time="2026-09-08T07:12:17.738Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXRHPVDDBN3JWGSPEBCTE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:27.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:17.729" grpc.time_ms=9.175 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 217.429783] sidekiq-cluster[2532]: 2026-09-08T07:12:17.755Z pid=2532 tid=xu4 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2532, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>449830912} gitlab # [ 217.448775] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 145 gitlab # [ 217.450455] nixbot[2656]: {"ts": "2026-09-08T07:12:17.774Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a \"HTTP/1.1 201 Created\""} gitlab # [ 217.596485] sidekiq-cluster[2532]: W, [2026-09-08T07:12:17.922148 #2532] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 217.633753] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:17.959Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 217.829517] gitaly[913]: time="2026-09-08T07:12:18.155Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXRJ5CT6F39RPTAMDX5VEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:18.147" grpc.time_ms=7.189 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 217.859964] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 93 gitlab # [ 217.921789] gitaly[913]: time="2026-09-08T07:12:18.247Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXRJ8DGRDH17A7C9BKEQ6J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:18.239" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 217.943331] gitaly[913]: time="2026-09-08T07:12:18.247Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXRJ8DGRDH17A7C9BKEQ6J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:18.239" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 217.967851] gitaly[913]: time="2026-09-08T07:12:18.293Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXRJ8DGRDH17A7C9BKEQ6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:18.239" grpc.time_ms=53.555 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 217.981605] gitlab-workhorse[827]: time="2026-09-08T07:12:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 217.983552] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 104 gitlab # [ 218.058431] gitaly[913]: time="2026-09-08T07:12:18.384Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXRJCVVSKSEPADTYVFG2ZE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:18.377" grpc.time_ms=6.38 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 218.071462] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 65 gitlab # [ 218.114131] gitaly[913]: time="2026-09-08T07:12:18.439Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXRJEYNQT1KD6J43J01Q4R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:18.432" pid=913 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc gitlab # [ 218.114845] gitaly[913]: time="2026-09-08T07:12:18.439Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXRJEYNQT1KD6J43J01Q4R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:18.432" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 218.134844] gitaly[913]: time="2026-09-08T07:12:18.460Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXRJEYNQT1KD6J43J01Q4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:18.432" grpc.time_ms=7.017 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 218.135697] gitlab-workhorse[827]: time="2026-09-08T07:12:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 218.136527] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 62 gitlab # [ 219.412974] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:19.737Z","message":"GitLab reliable fetch activated!"} gitlab # [ 219.414967] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:19.737Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 238.784833] postgres[3198]: [3198] ERROR: relation "table_without_models" does not exist gitlab # [ 238.785603] postgres[3198]: [3198] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 241.150158] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:41.474Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 241.154602] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:41.475Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 241.159822] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:41.475Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 241.164202] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:41.475Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 241.168714] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:41.476Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 40.51 seconds) gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 242.011853] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:42 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 40 gitlab # [ 242.108404] gitaly[913]: time="2026-09-08T07:12:42.433Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9V82QVM3TEJR88RSV7Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:42.424" grpc.time_ms=9.368 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 242.120461] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:42 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 90 gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 242.366130] gitaly[913]: time="2026-09-08T07:12:42.691Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-08T07:13:12.584" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-08T07:12:42.684" grpc.time_ms=7.107 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.387791] gitaly[913]: time="2026-09-08T07:12:42.713Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 duration_ms=77ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 242.432811] gitaly[913]: time="2026-09-08T07:12:42.758Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 duration_ms=43ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 242.438166] gitaly[913]: time="2026-09-08T07:12:42.758Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:42.633" grpc.time_ms=124.931 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 242.459638] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:42.784Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"64f78d011b6f5192ad532be8","created_at":"2026-09-08T07:11:51.391Z","trace_propagation_headers":{"sentry-trace":"9b75dbf75d9a420183a86e3665099f55-b74c7be626634e44","baggage":"sentry-trace_id=9b75dbf75d9a420183a86e3665099f55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXQQAZ7WEYC1MEFCY59BDS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:51.417Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-64f78d011b6f5192ad532be8: start","job_status":"start","queue_duration_s":51.366964,"scheduling_latency_s":51.367044} gitlab # [ 242.476989] gitaly[913]: time="2026-09-08T07:12:42.802Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:42.801" grpc.time_ms=0.743 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 242.519345] gitaly[913]: time="2026-09-08T07:12:42.844Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:42.844" grpc.time_ms=0.59 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 242.553076] gitaly[913]: time="2026-09-08T07:12:42.878Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:42.878" grpc.time_ms=0.349 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 242.610685] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:42.935Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"64f78d011b6f5192ad532be8","created_at":"2026-09-08T07:11:51.391Z","trace_propagation_headers":{"sentry-trace":"9b75dbf75d9a420183a86e3665099f55-b74c7be626634e44","baggage":"sentry-trace_id=9b75dbf75d9a420183a86e3665099f55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXQQAZ7WEYC1MEFCY59BDS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:51.417Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-64f78d011b6f5192ad532be8: done: 0.15206 sec","job_status":"done","queue_duration_s":51.366964,"scheduling_latency_s":51.367044,"redis_calls":23,"redis_duration_s":0.0051719999999999995,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.002437,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00167,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.077543375,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.15206,"completed_at":"2026-09-08T07:12:42.935Z","load_balancing_strategy":"primary","db_duration_s":0.035397,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 242.611802] gitaly[913]: time="2026-09-08T07:12:42.936Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 duration_ms=30ns method=POST pid=913 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 242.613562] gitaly[913]: time="2026-09-08T07:12:42.936Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:42.905" grpc.time_ms=31.497 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 242.663208] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:42.988Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e7c62c2aef7e0e7a15a4a54c","created_at":"2026-09-08T07:11:51.424Z","trace_propagation_headers":{"sentry-trace":"9b75dbf75d9a420183a86e3665099f55-b74c7be626634e44","baggage":"sentry-trace_id=9b75dbf75d9a420183a86e3665099f55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXQQAZ7WEYC1MEFCY59BDS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:51.428Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e7c62c2aef7e0e7a15a4a54c: start","job_status":"start","queue_duration_s":51.560007,"scheduling_latency_s":51.560043} gitlab # [ 242.687122] gitaly[913]: time="2026-09-08T07:12:43.012Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 diskcache=837fffd6-556d-4ba4-b460-e375d50ead56 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:42.552" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 242.688956] gitaly[913]: time="2026-09-08T07:12:43.013Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=214 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=876544 command.minflt=13615 command.oublock=32 command.real_time_ms=450 command.spawn_token_fork_ms=0 command.system_time_ms=140 command.user_time_ms=74 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:42.552" grpc.time_ms=460.828 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 242.690564] gitlab-workhorse[827]: time="2026-09-08T07:12:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 242.691306] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:43 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 551 gitlab # To http://gitlab/root/test-flake.git gitlab # c210e88..71d9770 master -> master gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.80 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b' gitlab # [ 242.739067] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:43.064Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e7c62c2aef7e0e7a15a4a54c","created_at":"2026-09-08T07:11:51.424Z","trace_propagation_headers":{"sentry-trace":"9b75dbf75d9a420183a86e3665099f55-b74c7be626634e44","baggage":"sentry-trace_id=9b75dbf75d9a420183a86e3665099f55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXQQAZ7WEYC1MEFCY59BDS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:51.428Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e7c62c2aef7e0e7a15a4a54c: done: 0.075986 sec","job_status":"done","queue_duration_s":51.560007,"scheduling_latency_s":51.560043,"redis_calls":14,"redis_duration_s":0.0020629999999999997,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000401,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.058239245,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.075986,"completed_at":"2026-09-08T07:12:43.064Z","load_balancing_strategy":"primary","db_duration_s":0.015068,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 242.779116] nixbot[2656]: INFO: ::ffff:127.0.0.1:59146 - "GET /api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b', in 0.06 seconds) gitlab # [ 242.782567] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:43.107Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"80286bf0a39f424d664d458a","created_at":"2026-09-08T07:11:51.958Z","trace_propagation_headers":{"sentry-trace":"9b75dbf75d9a420183a86e3665099f55-b74c7be626634e44","baggage":"sentry-trace_id=9b75dbf75d9a420183a86e3665099f55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXQQAZ7WEYC1MEFCY59BDS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:51.963Z","job_size_bytes":5,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-80286bf0a39f424d664d458a: start","job_status":"start","queue_duration_s":51.144073,"scheduling_latency_s":51.144097} gitlab # [ 242.917489] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:43.242Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"80286bf0a39f424d664d458a","created_at":"2026-09-08T07:11:51.958Z","trace_propagation_headers":{"sentry-trace":"9b75dbf75d9a420183a86e3665099f55-b74c7be626634e44","baggage":"sentry-trace_id=9b75dbf75d9a420183a86e3665099f55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXQQAZ7WEYC1MEFCY59BDS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:51.963Z","job_size_bytes":5,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-80286bf0a39f424d664d458a: done: 0.134814 sec","job_status":"done","queue_duration_s":51.144073,"scheduling_latency_s":51.144097,"redis_calls":12,"redis_duration_s":0.001961,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000393,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001258,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00031,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000384407,"duration_s":0.134814,"completed_at":"2026-09-08T07:12:43.242Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0181,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 242.920471] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:43.244Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"8bf5a399794818ebc30afa5a","created_at":"2026-09-08T07:11:51.984Z","trace_propagation_headers":{"sentry-trace":"9b75dbf75d9a420183a86e3665099f55-b74c7be626634e44","baggage":"sentry-trace_id=9b75dbf75d9a420183a86e3665099f55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXQQAZ7WEYC1MEFCY59BDS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:51.992Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-8bf5a399794818ebc30afa5a: start","job_status":"start","queue_duration_s":51.25176,"scheduling_latency_s":51.251786} gitlab # [ 243.104495] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:43.429Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"8bf5a399794818ebc30afa5a","created_at":"2026-09-08T07:11:51.984Z","trace_propagation_headers":{"sentry-trace":"9b75dbf75d9a420183a86e3665099f55-b74c7be626634e44","baggage":"sentry-trace_id=9b75dbf75d9a420183a86e3665099f55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXQQAZ7WEYC1MEFCY59BDS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:51.992Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-8bf5a399794818ebc30afa5a: done: 0.185622 sec","job_status":"done","queue_duration_s":51.25176,"scheduling_latency_s":51.251786,"redis_calls":11,"redis_duration_s":0.001759,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000385,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001057,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000317,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.162,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.162,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000263721,"duration_s":0.185622,"completed_at":"2026-09-08T07:12:43.429Z","load_balancing_strategy":"primary","db_duration_s":0.094926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.107501] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:43.431Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"8360f477d3db2714f9587b1a","created_at":"2026-09-08T07:11:51.996Z","trace_propagation_headers":{"sentry-trace":"9b75dbf75d9a420183a86e3665099f55-b74c7be626634e44","baggage":"sentry-trace_id=9b75dbf75d9a420183a86e3665099f55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXQQAZ7WEYC1MEFCY59BDS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:52.003Z","job_size_bytes":89,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-8360f477d3db2714f9587b1a: start","job_status":"start","queue_duration_s":51.428028,"scheduling_latency_s":51.428042} gitlab # [ 243.138195] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:43.456Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"8360f477d3db2714f9587b1a","created_at":"2026-09-08T07:11:51.996Z","trace_propagation_headers":{"sentry-trace":"9b75dbf75d9a420183a86e3665099f55-b74c7be626634e44","baggage":"sentry-trace_id=9b75dbf75d9a420183a86e3665099f55,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXQQAZ7WEYC1MEFCY59BDS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-08T07:11:52.003Z","job_size_bytes":89,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-8360f477d3db2714f9587b1a: done: 0.025748 sec","job_status":"done","queue_duration_s":51.428028,"scheduling_latency_s":51.428042,"redis_calls":11,"redis_duration_s":0.002421,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000552,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001489,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00038,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000348089,"duration_s":0.025748,"completed_at":"2026-09-08T07:12:43.456Z","load_balancing_strategy":"primary","db_duration_s":0.005071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.196811] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:43.458Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 c210e880bc7e1858923395a18a5aad313ef0848a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7d21c81468ab65918c3fcaa7","created_at":"2026-09-08T07:11:58.530Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-fa33013a31894fdb","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:58.550Z","job_size_bytes":185,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7d21c81468ab65918c3fcaa7: start","job_status":"start","queue_duration_s":44.907799,"scheduling_latency_s":44.907813} gitlab # [ 243.206909] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:43.469Z","message":"changes: \"0000000000000000000000000000000000000000 c210e880bc7e1858923395a18a5aad313ef0848a refs/heads/master\\n\""} gitlab # [ 243.209745] gitaly[913]: time="2026-09-08T07:12:43.506Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:53.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:43.495" grpc.time_ms=10.575 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.257646] gitaly[913]: time="2026-09-08T07:12:43.519Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T07:12:53.019" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:12:43.510" grpc.time_ms=8.549 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.258450] gitaly[913]: time="2026-09-08T07:12:43.576Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-08T07:12:53.078" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:43.568" grpc.time_ms=7.472 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.286088] gitaly[913]: time="2026-09-08T07:12:43.611Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:43.611" grpc.time_ms=0.238 pid=913 span.kind=server system=grpc gitlab # [ 243.318132] gitaly[913]: time="2026-09-08T07:12:43.643Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:43.643" grpc.time_ms=0.229 pid=913 span.kind=server system=grpc gitlab # [ 243.337266] gitaly[913]: time="2026-09-08T07:12:43.662Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K diskcache=902082b1-b056-412d-9bdb-9bedd0e91319 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T07:12:53.095" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:12:43.585" pid=913 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 243.346891] gitaly[913]: time="2026-09-08T07:12:43.672Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=62 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5024 command.oublock=8 command.real_time_ms=69 command.spawn_token_fork_ms=0 command.system_time_ms=49 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T07:12:53.095" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:12:43.585" grpc.time_ms=77.595 pid=913 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 243.359100] gitaly[913]: time="2026-09-08T07:12:43.684Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T07:12:53.193" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:12:43.684" grpc.time_ms=0.205 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.374539] gitaly[913]: time="2026-09-08T07:12:43.700Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=940 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-08T07:12:53.199" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:43.690" grpc.time_ms=10.042 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.428804] gitaly[913]: time="2026-09-08T07:12:43.754Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-08T07:13:13.049" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:43.749" grpc.time_ms=4.545 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.461295] gitaly[913]: time="2026-09-08T07:12:43.786Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-08T07:12:53.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:12:43.786" grpc.time_ms=0.265 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.469707] gitaly[913]: time="2026-09-08T07:12:43.795Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-08T07:12:53.009" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-08T07:12:43.789" grpc.time_ms=5.984 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.507688] gitaly[913]: time="2026-09-08T07:12:43.833Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:53.044" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:43.824" grpc.time_ms=8.554 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.523632] gitaly[913]: time="2026-09-08T07:12:43.847Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:53.058" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:43.838" grpc.time_ms=8.667 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.547564] gitaly[913]: time="2026-09-08T07:12:43.873Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-08T07:13:13.157" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:43.858" grpc.time_ms=14.859 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b' gitlab # [ 243.816919] nixbot[2656]: INFO: ::ffff:127.0.0.1:49806 - "GET /api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b', in 0.04 seconds) gitlab # [ 243.877835] gitaly[913]: time="2026-09-08T07:12:44.203Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-08T07:12:54.001" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:44.202" grpc.time_ms=1.19 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.906432] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:44.228Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 c210e880bc7e1858923395a18a5aad313ef0848a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7d21c81468ab65918c3fcaa7","created_at":"2026-09-08T07:11:58.530Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-fa33013a31894fdb","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:11:58.550Z","job_size_bytes":185,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7d21c81468ab65918c3fcaa7: done: 0.770109 sec","job_status":"done","queue_duration_s":44.907799,"scheduling_latency_s":44.907813,"gitaly_calls":13,"gitaly_duration_s":0.2237,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.037276000000000004,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.003131,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.005654,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001294,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004089,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.013921,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.009187,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.166,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.18,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.468787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000462908,"exclusive_lock_hold_duration_s":0.030713960000000002,"duration_s":0.770109,"completed_at":"2026-09-08T07:12:44.228Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.067996,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 243.970246] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:44.229Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"200f8562d60862cfd85371f1","created_at":"2026-09-08T07:12:03.411Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-efe74d4a26c042bd","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:03.419Z","job_size_bytes":65,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-200f8562d60862cfd85371f1: start","job_status":"start","queue_duration_s":40.810389,"scheduling_latency_s":40.810416} gitlab # [ 243.985095] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:44.296Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"200f8562d60862cfd85371f1","created_at":"2026-09-08T07:12:03.411Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-efe74d4a26c042bd","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:03.419Z","job_size_bytes":65,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-200f8562d60862cfd85371f1: done: 0.066862 sec","job_status":"done","queue_duration_s":40.810389,"scheduling_latency_s":40.810416,"redis_calls":16,"redis_duration_s":0.004422,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002487,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001346,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000589,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031261,"duration_s":0.066862,"completed_at":"2026-09-08T07:12:44.296Z","load_balancing_strategy":"primary","db_duration_s":0.025468,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 244.024271] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:44.297Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"84aed9061081b7482242438c","created_at":"2026-09-08T07:12:03.420Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-efe74d4a26c042bd","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:03.423Z","job_size_bytes":65,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-84aed9061081b7482242438c: start","job_status":"start","queue_duration_s":40.87449,"scheduling_latency_s":40.874505} gitlab # [ 244.107516] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:44.432Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"84aed9061081b7482242438c","created_at":"2026-09-08T07:12:03.420Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-efe74d4a26c042bd","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:03.423Z","job_size_bytes":65,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-84aed9061081b7482242438c: done: 0.13476 sec","job_status":"done","queue_duration_s":40.87449,"scheduling_latency_s":40.874505,"redis_calls":21,"redis_duration_s":0.004986,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002133,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001502,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001351,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000307581,"duration_s":0.13476,"completed_at":"2026-09-08T07:12:44.432Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031961,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.111338] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:44.434Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a9934387c96b3146438d61fc","created_at":"2026-09-08T07:12:03.518Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-efe74d4a26c042bd","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:03.523Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a9934387c96b3146438d61fc: start","job_status":"start","queue_duration_s":40.910792,"scheduling_latency_s":40.910806} gitlab # [ 244.243564] gitaly[913]: time="2026-09-08T07:12:44.568Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:44.567" grpc.time_ms=0.604 pid=913 span.kind=server system=grpc gitlab # [ 244.286319] gitaly[913]: time="2026-09-08T07:12:44.611Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:44.611" grpc.time_ms=0.63 pid=913 span.kind=server system=grpc gitlab # [ 244.331698] gitaly[913]: time="2026-09-08T07:12:44.656Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:44.656" grpc.time_ms=0.34 pid=913 span.kind=server system=grpc gitlab # [ 244.354109] gitaly[913]: time="2026-09-08T07:12:44.679Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 diskcache=e836f1d1-0d88-4fcb-9119-893fb61075f6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:14.032" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:44.532" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.355347] gitaly[913]: time="2026-09-08T07:12:44.680Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=137 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7294 command.oublock=0 command.real_time_ms=137 command.spawn_token_fork_ms=0 command.system_time_ms=94 command.user_time_ms=43 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:14.032" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:44.532" grpc.time_ms=147.272 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.491110] gitaly[913]: time="2026-09-08T07:12:44.816Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T07:13:14.114" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:44.815" grpc.time_ms=1.097 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.522955] gitaly[913]: time="2026-09-08T07:12:44.848Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXR3EPVQXAVVC3DQKD04D1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:14.147" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:44.847" grpc.time_ms=0.762 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.548399] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:44.857Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a9934387c96b3146438d61fc","created_at":"2026-09-08T07:12:03.518Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-efe74d4a26c042bd","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:03.523Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2532,"job_status":"rescheduled","message":"PipelineProcessWorker JID-a9934387c96b3146438d61fc: rescheduled"} gitlab # [ 244.550127] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:44.863Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a9934387c96b3146438d61fc","created_at":"2026-09-08T07:12:03.518Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-efe74d4a26c042bd","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:03.523Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a9934387c96b3146438d61fc: done: 0.429405 sec","job_status":"done","queue_duration_s":40.910792,"scheduling_latency_s":40.910806,"gitaly_calls":3,"gitaly_duration_s":0.176342,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.027583,"redis_read_bytes":460,"redis_write_bytes":29295,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001155,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00106,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.010039,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.00463,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15582,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.00628,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000503,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000849,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001912,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.019,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.022,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.03,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.163704,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.386955046,"duration_s":0.429405,"completed_at":"2026-09-08T07:12:44.863Z","load_balancing_strategy":"primary","db_duration_s":0.071172,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 244.600538] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:44.865Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","c210e880bc7e1858923395a18a5aad313ef0848a 71d9770cc1955c24351c5f5ddaf2597e8921843b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"04b97a95903e42301c976c30","created_at":"2026-09-08T07:12:42.925Z","trace_propagation_headers":{"sentry-trace":"5de97a7f201649ef9e57556ad889f67d-a7f8208ddc044399","baggage":"sentry-trace_id=5de97a7f201649ef9e57556ad889f67d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXS9YYR3JEK2PEE81TA6R4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:42.926Z","job_size_bytes":185,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-04b97a95903e42301c976c30: start","job_status":"start","queue_duration_s":1.938115,"scheduling_latency_s":1.93813} gitlab # [ 244.601458] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:44.872Z","message":"changes: \"c210e880bc7e1858923395a18a5aad313ef0848a 71d9770cc1955c24351c5f5ddaf2597e8921843b refs/heads/master\\n\""} gitlab # [ 244.602282] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:44.914Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ba08c377a1c06dd9c973685f","created_at":"2026-09-08T07:12:44.912Z","trace_propagation_headers":{"sentry-trace":"5de97a7f201649ef9e57556ad889f67d-3b0a547d3c4a4663","baggage":"sentry-trace_id=5de97a7f201649ef9e57556ad889f67d,sentry-release=Unknown"},"correlation_id":"01M1ZXS9YYR3JEK2PEE81TA6R4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"fa59cf5deac94c2b9892ee43","job_size_bytes":46,"pid":2532,"job_status":"deduplicated","message":"ProjectCacheWorker JID-ba08c377a1c06dd9c973685f: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 244.606646] gitaly[913]: time="2026-09-08T07:12:44.894Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:54.104" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:44.885" grpc.time_ms=9.455 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.618731] gitaly[913]: time="2026-09-08T07:12:44.908Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T07:12:54.117" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:12:44.898" grpc.time_ms=10.2 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.667834] gitaly[913]: time="2026-09-08T07:12:44.935Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-08T07:12:54.148" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:44.928" grpc.time_ms=6.309 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.668666] gitaly[913]: time="2026-09-08T07:12:44.943Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-08T07:13:14.237" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:44.937" grpc.time_ms=5.891 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.668990] gitaly[913]: time="2026-09-08T07:12:44.952Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=348 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-08T07:12:54.169" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-08T07:12:44.949" grpc.time_ms=2.872 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.669627] gitaly[913]: time="2026-09-08T07:12:44.964Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:54.179" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:44.959" grpc.time_ms=4.734 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.682295] gitaly[913]: time="2026-09-08T07:12:45.008Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-08T07:12:55.006" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:45.007" grpc.time_ms=0.801 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.692130] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:45.017Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","c210e880bc7e1858923395a18a5aad313ef0848a 71d9770cc1955c24351c5f5ddaf2597e8921843b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"04b97a95903e42301c976c30","created_at":"2026-09-08T07:12:42.925Z","trace_propagation_headers":{"sentry-trace":"5de97a7f201649ef9e57556ad889f67d-a7f8208ddc044399","baggage":"sentry-trace_id=5de97a7f201649ef9e57556ad889f67d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXS9YYR3JEK2PEE81TA6R4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:42.926Z","job_size_bytes":185,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-04b97a95903e42301c976c30: done: 0.152582 sec","job_status":"done","queue_duration_s":1.938115,"scheduling_latency_s":1.93813,"gitaly_calls":7,"gitaly_duration_s":0.052581,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.014355000000000001,"redis_read_bytes":501,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.001202,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000744,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001935,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.006276,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.004198,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000482743,"exclusive_lock_hold_duration_s":0.01647025,"duration_s":0.152582,"completed_at":"2026-09-08T07:12:45.017Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014327,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 244.740684] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:45.018Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"fa59cf5deac94c2b9892ee43","created_at":"2026-09-08T07:12:43.523Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-927e25da43d84519","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:43.546Z","job_size_bytes":46,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-fa59cf5deac94c2b9892ee43: start","job_status":"start","queue_duration_s":1.472288,"scheduling_latency_s":1.472305} gitlab # [ 244.747730] gitaly[913]: time="2026-09-08T07:12:45.046Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-08T13:12:45.043" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:12:45.044" grpc.time_ms=2.135 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.757271] gitaly[913]: time="2026-09-08T07:12:45.057Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-08T07:13:15.050" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:45.051" grpc.time_ms=6.304 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b' gitlab # [ 244.796196] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:45.077Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"fa59cf5deac94c2b9892ee43","created_at":"2026-09-08T07:12:43.523Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-927e25da43d84519","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:43.546Z","job_size_bytes":46,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-fa59cf5deac94c2b9892ee43: done: 0.058801 sec","job_status":"done","queue_duration_s":1.472288,"scheduling_latency_s":1.472305,"gitaly_calls":2,"gitaly_duration_s":0.011515,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.003993,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000749,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000345,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.001555,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000369,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201702,"duration_s":0.058801,"completed_at":"2026-09-08T07:12:45.077Z","load_balancing_strategy":"primary","db_duration_s":0.007848,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 244.833533] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:45.078Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5db9d3e8d4f316929f9cbe91","created_at":"2026-09-08T07:12:43.560Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-927e25da43d84519","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:43.564Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5db9d3e8d4f316929f9cbe91: start","job_status":"start","queue_duration_s":1.514217,"scheduling_latency_s":1.514232} gitlab # [ 244.872747] gitaly[913]: time="2026-09-08T07:12:45.198Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K diskcache=d2b3c12f-6fac-4634-83a6-c84a56d41829 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-08T13:12:45.092" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:45.092" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.873571] gitaly[913]: time="2026-09-08T07:12:45.198Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1279 command.oublock=0 command.real_time_ms=102 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-08T13:12:45.092" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:45.092" grpc.time_ms=105.759 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.877542] nixbot[2656]: INFO: ::ffff:127.0.0.1:49816 - "GET /api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b', in 0.08 seconds) gitlab # [ 244.899420] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:45.224Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5db9d3e8d4f316929f9cbe91","created_at":"2026-09-08T07:12:43.560Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-927e25da43d84519","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:43.564Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5db9d3e8d4f316929f9cbe91: done: 0.146184 sec","job_status":"done","queue_duration_s":1.514217,"scheduling_latency_s":1.514232,"gitaly_calls":1,"gitaly_duration_s":0.107535,"redis_calls":15,"redis_duration_s":0.002038,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000342,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000689,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.131730988,"duration_s":0.146184,"completed_at":"2026-09-08T07:12:45.224Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.901207] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:45.225Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"9893f9591eb1c3e85ac5d169","created_at":"2026-09-08T07:12:43.680Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-927e25da43d84519","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:43.681Z","job_size_bytes":23,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9893f9591eb1c3e85ac5d169: start","job_status":"start","queue_duration_s":1.544027,"scheduling_latency_s":1.544042} gitlab # [ 244.921425] gitaly[913]: time="2026-09-08T07:12:45.247Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=656 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-08T07:13:15.241" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:45.242" grpc.time_ms=4.982 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.929866] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:45.255Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"9893f9591eb1c3e85ac5d169","created_at":"2026-09-08T07:12:43.680Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-927e25da43d84519","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:43.681Z","job_size_bytes":23,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9893f9591eb1c3e85ac5d169: done: 0.029116 sec","job_status":"done","queue_duration_s":1.544027,"scheduling_latency_s":1.544042,"gitaly_calls":1,"gitaly_duration_s":0.00672,"redis_calls":16,"redis_duration_s":0.002239,"redis_read_bytes":52,"redis_write_bytes":2045,"redis_queues_calls":1,"redis_queues_duration_s":0.000197,"redis_queues_read_bytes":1,"redis_queues_write_bytes":976,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.000989,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000411,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029116,"completed_at":"2026-09-08T07:12:45.255Z","load_balancing_strategy":"primary","db_duration_s":0.001474,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 244.967109] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:45.256Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8e815e8cfc9da9afcef0fe0f","created_at":"2026-09-08T07:12:44.091Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-927e25da43d84519","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:67c01479f696ed449a6f5bc786b35e020d20e75178c4798647a931f3c5d8db66","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.094Z","job_size_bytes":467,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8e815e8cfc9da9afcef0fe0f: start","job_status":"start","queue_duration_s":1.16164,"scheduling_latency_s":1.161661} gitlab # [ 245.018342] gitaly[913]: time="2026-09-08T07:12:45.274Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:15.273" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:45.273" grpc.time_ms=0.497 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.019123] gitaly[913]: time="2026-09-08T07:12:45.280Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-08T07:12:55.275" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:45.275" grpc.time_ms=4.794 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.024598] gitaly[913]: time="2026-09-08T07:12:45.350Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T07:13:15.349" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:45.349" grpc.time_ms=0.781 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.028692] gitaly[913]: time="2026-09-08T07:12:45.354Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=33 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-08T07:13:15.352" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:45.352" grpc.time_ms=1.736 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.087831] gitaly[913]: time="2026-09-08T07:12:45.413Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:55.206" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:45.407" grpc.time_ms=6.178 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.441452] gitaly[913]: time="2026-09-08T07:12:45.766Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-08T07:13:15.752" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:45.752" grpc.time_ms=13.892 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.484433] gitaly[913]: time="2026-09-08T07:12:45.810Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXQYFPHD2BASP7K5J8H60K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-08T07:13:15.799" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:45.800" grpc.time_ms=9.659 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.505210] sidekiq-cluster[2532]: {"severity":"WARN","time":"2026-09-08T07:12:45.830Z","class":"CreatePipelineWorker","correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"c210e880bc7e1858923395a18a5aad313ef0848a","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"c210e880bc7e1858923395a18a5aad313ef0848a","ref":"refs/heads/master"},"retry":0} gitlab # [ 245.509825] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:45.835Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8e815e8cfc9da9afcef0fe0f","created_at":"2026-09-08T07:12:44.091Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-927e25da43d84519","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:67c01479f696ed449a6f5bc786b35e020d20e75178c4798647a931f3c5d8db66","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.094Z","job_size_bytes":467,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8e815e8cfc9da9afcef0fe0f: done: 0.579106 sec","job_status":"done","queue_duration_s":1.16164,"scheduling_latency_s":1.161661,"gitaly_calls":7,"gitaly_duration_s":0.08071,"redis_calls":51,"redis_duration_s":0.006023,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000503,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.002544,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001607,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000628,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.458809,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197791,"duration_s":0.579106,"completed_at":"2026-09-08T07:12:45.835Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032587,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 245.523126] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:45.836Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"928ebf26-f092-4842-9427-aa0d9a596688\"}"],"class":"WebHookWorker","jid":"05bea392fc0117e4f553402d","created_at":"2026-09-08T07:12:44.177Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-927e25da43d84519","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b37a68b9a2c4f40cd35552ddb2ab40d292a561e9d37158f669d5d50764c12a5e","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.182Z","job_size_bytes":1751,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-05bea392fc0117e4f553402d: start","job_status":"start","queue_duration_s":1.653878,"scheduling_latency_s":1.653894} gitlab # [ 245.608665] nixbot[2656]: INFO: ::ffff:127.0.0.1:49826 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 245.632707] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:45.957Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"928ebf26-f092-4842-9427-aa0d9a596688\"}"],"class":"WebHookWorker","jid":"05bea392fc0117e4f553402d","created_at":"2026-09-08T07:12:44.177Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-927e25da43d84519","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b37a68b9a2c4f40cd35552ddb2ab40d292a561e9d37158f669d5d50764c12a5e","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.182Z","job_size_bytes":1751,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-05bea392fc0117e4f553402d: done: 0.121256 sec","job_status":"done","queue_duration_s":1.653878,"scheduling_latency_s":1.653894,"redis_calls":19,"redis_duration_s":0.004394,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001015,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000584,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002116,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000679,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.04420841199998904,"cpu_s":0.061153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000644216,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.121256,"completed_at":"2026-09-08T07:12:45.957Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.636665] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:45.960Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2000adb203772006b662c349","created_at":"2026-09-08T07:12:44.521Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.524Z","job_size_bytes":23,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2000adb203772006b662c349: start","job_status":"start","queue_duration_s":1.435394,"scheduling_latency_s":1.435427} gitlab # [ 245.692433] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.017Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2000adb203772006b662c349","created_at":"2026-09-08T07:12:44.521Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.524Z","job_size_bytes":23,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2000adb203772006b662c349: done: 0.057539 sec","job_status":"done","queue_duration_s":1.435394,"scheduling_latency_s":1.435427,"redis_calls":10,"redis_duration_s":0.00211,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000523,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001197,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00039,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000239137,"duration_s":0.057539,"completed_at":"2026-09-08T07:12:46.017Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0094,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 245.733210] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.058Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"8ff39fe37913b114a856f4ff","created_at":"2026-09-08T07:12:44.705Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.709Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-8ff39fe37913b114a856f4ff: start","job_status":"start","queue_duration_s":1.348893,"scheduling_latency_s":1.348926} gitlab # [ 245.748277] gitaly[913]: time="2026-09-08T07:12:46.069Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSDC2DFV2V0HZ9J083BCR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:46.063" grpc.time_ms=6.218 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 245.749223] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 115 gitlab # [ 245.761135] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.086Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"8ff39fe37913b114a856f4ff","created_at":"2026-09-08T07:12:44.705Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.709Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-8ff39fe37913b114a856f4ff: done: 0.028106 sec","job_status":"done","queue_duration_s":1.348893,"scheduling_latency_s":1.348926,"redis_calls":10,"redis_duration_s":0.0017560000000000002,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001167,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000324,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000227683,"duration_s":0.028106,"completed_at":"2026-09-08T07:12:46.086Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004288,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.762195] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.087Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"71dd190ce4a7d3abd3da4c7d","created_at":"2026-09-08T07:12:44.718Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.728Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-71dd190ce4a7d3abd3da4c7d: start","job_status":"start","queue_duration_s":1.359149,"scheduling_latency_s":1.359164} gitlab # [ 245.783164] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.108Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"71dd190ce4a7d3abd3da4c7d","created_at":"2026-09-08T07:12:44.718Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.728Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-71dd190ce4a7d3abd3da4c7d: done: 0.021071 sec","job_status":"done","queue_duration_s":1.359149,"scheduling_latency_s":1.359164,"redis_calls":10,"redis_duration_s":0.001253,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000233828,"duration_s":0.021071,"completed_at":"2026-09-08T07:12:46.108Z","load_balancing_strategy":"primary","db_duration_s":0.002829,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.833113] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.109Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"aa20d73694fb01c120cdce2b","created_at":"2026-09-08T07:12:44.748Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.755Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-aa20d73694fb01c120cdce2b: start","job_status":"start","queue_duration_s":1.354026,"scheduling_latency_s":1.354039} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b' gitlab # [ 245.833768] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.131Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"aa20d73694fb01c120cdce2b","created_at":"2026-09-08T07:12:44.748Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.755Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-aa20d73694fb01c120cdce2b: done: 0.021594 sec","job_status":"done","queue_duration_s":1.354026,"scheduling_latency_s":1.354039,"redis_calls":13,"redis_duration_s":0.001613,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000366,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198628,"duration_s":0.021594,"completed_at":"2026-09-08T07:12:46.131Z","load_balancing_strategy":"primary","db_duration_s":0.002928,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.868655] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.132Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a551671e547d9c9122dd7a7f","created_at":"2026-09-08T07:12:44.756Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.762Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a551671e547d9c9122dd7a7f: start","job_status":"start","queue_duration_s":1.370028,"scheduling_latency_s":1.37004} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b', in 0.03 seconds) gitlab # [ 245.883631] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.150Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a551671e547d9c9122dd7a7f","created_at":"2026-09-08T07:12:44.756Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.762Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a551671e547d9c9122dd7a7f: done: 0.018853 sec","job_status":"done","queue_duration_s":1.370028,"scheduling_latency_s":1.37004,"redis_calls":10,"redis_duration_s":0.001235,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191644,"duration_s":0.018853,"completed_at":"2026-09-08T07:12:46.150Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.933077] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.151Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"12d01e5b62cc07ae0b54abec","created_at":"2026-09-08T07:12:44.762Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.768Z","job_size_bytes":19,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-12d01e5b62cc07ae0b54abec: start","job_status":"start","queue_duration_s":1.382926,"scheduling_latency_s":1.382939} gitlab # [ 245.936380] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.169Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"12d01e5b62cc07ae0b54abec","created_at":"2026-09-08T07:12:44.762Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.768Z","job_size_bytes":19,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-12d01e5b62cc07ae0b54abec: done: 0.017566 sec","job_status":"done","queue_duration_s":1.382926,"scheduling_latency_s":1.382939,"redis_calls":11,"redis_duration_s":0.0015869999999999999,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000454,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000874,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201143,"duration_s":0.017566,"completed_at":"2026-09-08T07:12:46.169Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.977647] nixbot[2656]: INFO: ::ffff:127.0.0.1:49828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b HTTP/1.1" 200 OK gitlab # [ 245.978440] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.170Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"66d9579f3ef37495057eabcd","created_at":"2026-09-08T07:12:44.772Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.777Z","job_size_bytes":66,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-66d9579f3ef37495057eabcd: start","job_status":"start","queue_duration_s":1.393244,"scheduling_latency_s":1.393258} gitlab # [ 246.016163] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.189Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"66d9579f3ef37495057eabcd","created_at":"2026-09-08T07:12:44.772Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.777Z","job_size_bytes":66,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-66d9579f3ef37495057eabcd: done: 0.018875 sec","job_status":"done","queue_duration_s":1.393244,"scheduling_latency_s":1.393258,"redis_calls":10,"redis_duration_s":0.001248,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000276013,"duration_s":0.018875,"completed_at":"2026-09-08T07:12:46.189Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.054816] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.190Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"1e06cc99ae6469a2256feb2d","created_at":"2026-09-08T07:12:44.778Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.782Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1e06cc99ae6469a2256feb2d: start","job_status":"start","queue_duration_s":1.407571,"scheduling_latency_s":1.407583} gitlab # [ 246.055545] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.213Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"1e06cc99ae6469a2256feb2d","created_at":"2026-09-08T07:12:44.778Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.782Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1e06cc99ae6469a2256feb2d: done: 0.023049 sec","job_status":"done","queue_duration_s":1.407571,"scheduling_latency_s":1.407583,"redis_calls":10,"redis_duration_s":0.001246,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00020226,"duration_s":0.023049,"completed_at":"2026-09-08T07:12:46.213Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.107315] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.214Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c4544c17e9d002c77bfad3e7","created_at":"2026-09-08T07:12:44.789Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.792Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c4544c17e9d002c77bfad3e7: start","job_status":"start","queue_duration_s":1.421864,"scheduling_latency_s":1.421877} gitlab # [ 246.107947] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.236Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c4544c17e9d002c77bfad3e7","created_at":"2026-09-08T07:12:44.789Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.792Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c4544c17e9d002c77bfad3e7: done: 0.021999 sec","job_status":"done","queue_duration_s":1.421864,"scheduling_latency_s":1.421877,"redis_calls":10,"redis_duration_s":0.0012439999999999999,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000244,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024612,"duration_s":0.021999,"completed_at":"2026-09-08T07:12:46.236Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005997,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.149772] gitaly[913]: time="2026-09-08T07:12:46.428Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 diskcache=2f95a56b-ce3a-4314-88cb-c01c540e72eb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-08T13:12:46.418" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:46.418" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.150571] gitaly[913]: time="2026-09-08T07:12:46.429Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-08T13:12:46.418" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:46.418" grpc.time_ms=10.116 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.189760] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.237Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f551275946f20d17f7d0dd6a","created_at":"2026-09-08T07:12:44.792Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.795Z","job_size_bytes":6,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f551275946f20d17f7d0dd6a: start","job_status":"start","queue_duration_s":1.441762,"scheduling_latency_s":1.441775} gitlab # [ 246.190621] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.254Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f551275946f20d17f7d0dd6a","created_at":"2026-09-08T07:12:44.792Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.795Z","job_size_bytes":6,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f551275946f20d17f7d0dd6a: done: 0.017227 sec","job_status":"done","queue_duration_s":1.441762,"scheduling_latency_s":1.441775,"redis_calls":10,"redis_duration_s":0.004338,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001691,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002399,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000236902,"duration_s":0.017227,"completed_at":"2026-09-08T07:12:46.254Z","load_balancing_strategy":"primary","db_duration_s":0.001435,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.229906] gitaly[913]: time="2026-09-08T07:12:46.453Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:16.452" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:46.452" grpc.time_ms=0.49 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.230595] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.255Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"30e0f93bbe67da48188d4220","created_at":"2026-09-08T07:12:44.795Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.798Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-30e0f93bbe67da48188d4220: start","job_status":"start","queue_duration_s":1.456915,"scheduling_latency_s":1.456928} gitlab # [ 246.234093] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.336Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"30e0f93bbe67da48188d4220","created_at":"2026-09-08T07:12:44.795Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.798Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-30e0f93bbe67da48188d4220: done: 0.081141 sec","job_status":"done","queue_duration_s":1.456915,"scheduling_latency_s":1.456928,"redis_calls":10,"redis_duration_s":0.001443,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194718,"duration_s":0.081141,"completed_at":"2026-09-08T07:12:46.336Z","load_balancing_strategy":"primary","db_duration_s":0.003713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.302936] gitaly[913]: time="2026-09-08T07:12:46.461Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-08T07:12:56.255" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:46.455" grpc.time_ms=5.532 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.303577] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.337Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"7d7e35cca668bb43718c87c1","created_at":"2026-09-08T07:12:44.803Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.806Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-7d7e35cca668bb43718c87c1: start","job_status":"start","queue_duration_s":1.531531,"scheduling_latency_s":1.531551} gitlab # [ 246.303861] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.377Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"7d7e35cca668bb43718c87c1","created_at":"2026-09-08T07:12:44.803Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.806Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-7d7e35cca668bb43718c87c1: done: 0.039509 sec","job_status":"done","queue_duration_s":1.531531,"scheduling_latency_s":1.531551,"redis_calls":14,"redis_duration_s":0.001786,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000751,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209244,"duration_s":0.039509,"completed_at":"2026-09-08T07:12:46.377Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00848,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.346689] gitaly[913]: time="2026-09-08T07:12:46.481Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T07:13:16.480" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:46.480" grpc.time_ms=0.58 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.347580] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.378Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7a6d8b595e2dc3f82a21b770","created_at":"2026-09-08T07:12:44.857Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.858Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7a6d8b595e2dc3f82a21b770: start","job_status":"start","queue_duration_s":1.519503,"scheduling_latency_s":1.519517} gitlab # [ 246.388281] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.407Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7a6d8b595e2dc3f82a21b770","created_at":"2026-09-08T07:12:44.857Z","trace_propagation_headers":{"sentry-trace":"ad0d223758fe4558b2a3911add2016da-e4d66861bb4b4b9c","baggage":"sentry-trace_id=ad0d223758fe4558b2a3911add2016da,sentry-release=Unknown"},"correlation_id":"01M1ZXR3EPVQXAVVC3DQKD04D1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.858Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7a6d8b595e2dc3f82a21b770: done: 0.029097 sec","job_status":"done","queue_duration_s":1.519503,"scheduling_latency_s":1.519517,"redis_calls":8,"redis_duration_s":0.001038,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029097,"completed_at":"2026-09-08T07:12:46.407Z","load_balancing_strategy":"primary","db_duration_s":0.002238,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 246.426176] gitaly[913]: time="2026-09-08T07:12:46.484Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=30 command.oublock=0 command.real_time_ms=0 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-08T07:13:16.483" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:46.483" grpc.time_ms=1.249 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.426771] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.408Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"af51ec990f13edc630c3e4d4","created_at":"2026-09-08T07:12:44.921Z","trace_propagation_headers":{"sentry-trace":"5de97a7f201649ef9e57556ad889f67d-3b0a547d3c4a4663","baggage":"sentry-trace_id=5de97a7f201649ef9e57556ad889f67d,sentry-release=Unknown"},"correlation_id":"01M1ZXS9YYR3JEK2PEE81TA6R4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5db9d3e8d4f316929f9cbe91","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.923Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-af51ec990f13edc630c3e4d4: start","job_status":"start","queue_duration_s":1.484389,"scheduling_latency_s":1.484403} gitlab # [ 246.427427] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.438Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"af51ec990f13edc630c3e4d4","created_at":"2026-09-08T07:12:44.921Z","trace_propagation_headers":{"sentry-trace":"5de97a7f201649ef9e57556ad889f67d-3b0a547d3c4a4663","baggage":"sentry-trace_id=5de97a7f201649ef9e57556ad889f67d,sentry-release=Unknown"},"correlation_id":"01M1ZXS9YYR3JEK2PEE81TA6R4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5db9d3e8d4f316929f9cbe91","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.923Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-af51ec990f13edc630c3e4d4: done: 0.030486 sec","job_status":"done","queue_duration_s":1.484389,"scheduling_latency_s":1.484403,"gitaly_calls":1,"gitaly_duration_s":0.011892,"redis_calls":12,"redis_duration_s":0.0017159999999999999,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000332,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000739,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.019339888,"duration_s":0.030486,"completed_at":"2026-09-08T07:12:46.438Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.486391] gitaly[913]: time="2026-09-08T07:12:46.503Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:56.298" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:46.498" grpc.time_ms=5.149 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.487157] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.439Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a134411490f269be8dd45e0a","created_at":"2026-09-08T07:12:44.989Z","trace_propagation_headers":{"sentry-trace":"5de97a7f201649ef9e57556ad889f67d-3b0a547d3c4a4663","baggage":"sentry-trace_id=5de97a7f201649ef9e57556ad889f67d,sentry-release=Unknown"},"correlation_id":"01M1ZXS9YYR3JEK2PEE81TA6R4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a258542e8835985d8eb7e77e3a001b3af0bc6b818ef5534cadf0edd844f6bd09","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.991Z","job_size_bytes":467,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a134411490f269be8dd45e0a: start","job_status":"start","queue_duration_s":1.448309,"scheduling_latency_s":1.448322} gitlab # [ 246.491710] gitaly[913]: time="2026-09-08T07:12:46.795Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-08T07:13:16.786" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:46.786" grpc.time_ms=8.554 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.539811] sidekiq-cluster[2532]: {"severity":"WARN","time":"2026-09-08T07:12:46.815Z","class":"CreatePipelineWorker","correlation_id":"01M1ZXS9YYR3JEK2PEE81TA6R4","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"c210e880bc7e1858923395a18a5aad313ef0848a","after":"71d9770cc1955c24351c5f5ddaf2597e8921843b","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"71d9770cc1955c24351c5f5ddaf2597e8921843b","ref":"refs/heads/master"},"retry":0} gitlab # [ 246.540604] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.818Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a134411490f269be8dd45e0a","created_at":"2026-09-08T07:12:44.989Z","trace_propagation_headers":{"sentry-trace":"5de97a7f201649ef9e57556ad889f67d-3b0a547d3c4a4663","baggage":"sentry-trace_id=5de97a7f201649ef9e57556ad889f67d,sentry-release=Unknown"},"correlation_id":"01M1ZXS9YYR3JEK2PEE81TA6R4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a258542e8835985d8eb7e77e3a001b3af0bc6b818ef5534cadf0edd844f6bd09","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:44.991Z","job_size_bytes":467,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a134411490f269be8dd45e0a: done: 0.379454 sec","job_status":"done","queue_duration_s":1.448309,"scheduling_latency_s":1.448322,"gitaly_calls":7,"gitaly_duration_s":0.039917,"redis_calls":33,"redis_duration_s":0.003228,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000339,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001646,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000624,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.328997,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.379454,"completed_at":"2026-09-08T07:12:46.818Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00984,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 246.585217] nixbot[2656]: INFO: ::ffff:127.0.0.1:49836 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 246.585799] gitaly[913]: time="2026-09-08T07:12:46.805Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXS9YYR3JEK2PEE81TA6R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-08T07:13:16.797" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:46.797" grpc.time_ms=7.715 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 246.586472] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.820Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"5f61eb1e-d492-44c7-90fa-a911f3f4a6d8\"}"],"class":"WebHookWorker","jid":"68ed667993408118b22870f6","created_at":"2026-09-08T07:12:44.999Z","trace_propagation_headers":{"sentry-trace":"5de97a7f201649ef9e57556ad889f67d-3b0a547d3c4a4663","baggage":"sentry-trace_id=5de97a7f201649ef9e57556ad889f67d,sentry-release=Unknown"},"correlation_id":"01M1ZXS9YYR3JEK2PEE81TA6R4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9a3077f190c1dcc746d7cce0636e64ebef806173c224178d0886ab8ea30be740","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:45.000Z","job_size_bytes":1749,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-68ed667993408118b22870f6: start","job_status":"start","queue_duration_s":1.819909,"scheduling_latency_s":1.819927} gitlab # [ 246.587103] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.877Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"5f61eb1e-d492-44c7-90fa-a911f3f4a6d8\"}"],"class":"WebHookWorker","jid":"68ed667993408118b22870f6","created_at":"2026-09-08T07:12:44.999Z","trace_propagation_headers":{"sentry-trace":"5de97a7f201649ef9e57556ad889f67d-3b0a547d3c4a4663","baggage":"sentry-trace_id=5de97a7f201649ef9e57556ad889f67d,sentry-release=Unknown"},"correlation_id":"01M1ZXS9YYR3JEK2PEE81TA6R4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9a3077f190c1dcc746d7cce0636e64ebef806173c224178d0886ab8ea30be740","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:45.000Z","job_size_bytes":1749,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-68ed667993408118b22870f6: done: 0.056919 sec","job_status":"done","queue_duration_s":1.819909,"scheduling_latency_s":1.819927,"redis_calls":14,"redis_duration_s":0.031049,"redis_read_bytes":25,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.029565,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000512,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.005489523999983703,"cpu_s":0.017195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.056919,"completed_at":"2026-09-08T07:12:46.876Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001227,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.633593] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.878Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ac968935305ace5710885fc8","created_at":"2026-09-08T07:12:45.066Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-4a628080d6624e09","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:45.070Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ac968935305ace5710885fc8: start","job_status":"start","queue_duration_s":1.807853,"scheduling_latency_s":1.807875} gitlab # [ 246.672248] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.909Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ac968935305ace5710885fc8","created_at":"2026-09-08T07:12:45.066Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-4a628080d6624e09","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:45.070Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ac968935305ace5710885fc8: done: 0.030955 sec","job_status":"done","queue_duration_s":1.807853,"scheduling_latency_s":1.807875,"redis_calls":19,"redis_duration_s":0.002667,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000452,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000323,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001179,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000713,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004531023,"duration_s":0.030955,"completed_at":"2026-09-08T07:12:46.909Z","load_balancing_strategy":"primary","db_duration_s":0.004883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.676897] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.910Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","05bea392fc0117e4f553402d"],"class":"WebHooks::LogExecutionWorker","jid":"3a8a957dc3d1522c197520d5","created_at":"2026-09-08T07:12:45.936Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-e2aa8423c72b4e5d","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:678cb7ea1d3cf998d816232e2d920df0c3027380e61b11f77579c791df35577e","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:45.945Z","job_size_bytes":2593,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-3a8a957dc3d1522c197520d5: start","job_status":"start","queue_duration_s":0.964506,"scheduling_latency_s":0.964519} gitlab # [ 246.692387] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.940Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","05bea392fc0117e4f553402d"],"class":"WebHooks::LogExecutionWorker","jid":"3a8a957dc3d1522c197520d5","created_at":"2026-09-08T07:12:45.936Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-e2aa8423c72b4e5d","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:678cb7ea1d3cf998d816232e2d920df0c3027380e61b11f77579c791df35577e","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:45.945Z","job_size_bytes":2593,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-3a8a957dc3d1522c197520d5: done: 0.030127 sec","job_status":"done","queue_duration_s":0.964506,"scheduling_latency_s":0.964519,"redis_calls":10,"redis_duration_s":0.001565,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000351,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000279924,"duration_s":0.030127,"completed_at":"2026-09-08T07:12:46.940Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005535,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.740710] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.941Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","68ed667993408118b22870f6"],"class":"WebHooks::LogExecutionWorker","jid":"65298b6a0aa87df1323dc450","created_at":"2026-09-08T07:12:46.840Z","trace_propagation_headers":{"sentry-trace":"5de97a7f201649ef9e57556ad889f67d-b5eb1167a847400d","baggage":"sentry-trace_id=5de97a7f201649ef9e57556ad889f67d,sentry-release=Unknown"},"correlation_id":"01M1ZXS9YYR3JEK2PEE81TA6R4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d27328ea2e2579f703aba3dbf7a5ff7575edf6ce8e306d733f1bdd7d7ec87326","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:46.843Z","job_size_bytes":2592,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-65298b6a0aa87df1323dc450: start","job_status":"start","queue_duration_s":0.098463,"scheduling_latency_s":0.098479} gitlab # [ 246.745844] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.958Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","68ed667993408118b22870f6"],"class":"WebHooks::LogExecutionWorker","jid":"65298b6a0aa87df1323dc450","created_at":"2026-09-08T07:12:46.840Z","trace_propagation_headers":{"sentry-trace":"5de97a7f201649ef9e57556ad889f67d-b5eb1167a847400d","baggage":"sentry-trace_id=5de97a7f201649ef9e57556ad889f67d,sentry-release=Unknown"},"correlation_id":"01M1ZXS9YYR3JEK2PEE81TA6R4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d27328ea2e2579f703aba3dbf7a5ff7575edf6ce8e306d733f1bdd7d7ec87326","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:46.843Z","job_size_bytes":2592,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-65298b6a0aa87df1323dc450: done: 0.01735 sec","job_status":"done","queue_duration_s":0.098463,"scheduling_latency_s":0.098479,"redis_calls":7,"redis_duration_s":0.000926,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01735,"completed_at":"2026-09-08T07:12:46.958Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00327,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.784160] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:46.959Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"9bce62db13898305eabe3938","created_at":"2026-09-08T07:12:46.900Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-b9117580b2b74de8","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:46.903Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-9bce62db13898305eabe3938: start","job_status":"start","queue_duration_s":0.056072,"scheduling_latency_s":0.056086} gitlab # [ 246.822401] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:47.013Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"9bce62db13898305eabe3938","created_at":"2026-09-08T07:12:46.900Z","trace_propagation_headers":{"sentry-trace":"36e0dc1129804591b0abf94f9564d8a2-b9117580b2b74de8","baggage":"sentry-trace_id=36e0dc1129804591b0abf94f9564d8a2,sentry-release=Unknown"},"correlation_id":"01M1ZXQYFPHD2BASP7K5J8H60K","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:46.903Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-9bce62db13898305eabe3938: done: 0.053779 sec","job_status":"done","queue_duration_s":0.056072,"scheduling_latency_s":0.056086,"redis_calls":11,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198349,"duration_s":0.053779,"completed_at":"2026-09-08T07:12:47.013Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013084,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b' gitlab # [ 246.932781] gitaly[913]: time="2026-09-08T07:12:47.258Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSDFQC7A7908DZ12K1PAN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.250" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 246.934405] gitaly[913]: time="2026-09-08T07:12:47.258Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSDFQC7A7908DZ12K1PAN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.250" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 246.935357] gitlab-workhorse[827]: time="2026-09-08T07:12:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 246.935722] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:47 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1187 gitlab # [ 246.936349] gitaly[913]: time="2026-09-08T07:12:47.258Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSDFQC7A7908DZ12K1PAN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.250" grpc.time_ms=7.902 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 246.970084] nixbot[2656]: INFO: ::ffff:127.0.0.1:49846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b', in 0.04 seconds) gitlab # [ 247.034868] gitaly[913]: time="2026-09-08T07:12:47.360Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSEMX3ZCR2H269SMFV74E grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.349" pid=913 remote_ip="2001:db8:1::1" request_sha=6cc55b412ccf11559fe3521f5480f6e53accf415 response_bytes=337 span.kind=server system=grpc gitlab # [ 247.035657] gitaly[913]: time="2026-09-08T07:12:47.360Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1193 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSEMX3ZCR2H269SMFV74E grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.349" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.036492] gitaly[913]: time="2026-09-08T07:12:47.361Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1193 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSEMX3ZCR2H269SMFV74E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.349" grpc.time_ms=11.974 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.037170] gitlab-workhorse[827]: time="2026-09-08T07:12:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=337 gitlab # [ 247.037578] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:47 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 100 gitlab # [ 247.074176] nixbot[2656]: {"ts": "2026-09-08T07:12:47.398Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 247.122164] gitaly[913]: time="2026-09-08T07:12:47.447Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSES2W56EQ4EH1Y878FN0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.441" grpc.time_ms=6.116 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.134063] gitaly[913]: time="2026-09-08T07:12:47.451Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:17.050" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:47.451" grpc.time_ms=0.518 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.145454] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:47 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 53 gitlab # [ 247.168513] gitaly[913]: time="2026-09-08T07:12:47.494Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSETS3AJ90THM3HT4V6T3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.487" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 247.169287] gitaly[913]: time="2026-09-08T07:12:47.494Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSETS3AJ90THM3HT4V6T3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.487" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.189636] gitaly[913]: time="2026-09-08T07:12:47.515Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSETS3AJ90THM3HT4V6T3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.487" grpc.time_ms=27.539 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.190798] gitlab-workhorse[827]: time="2026-09-08T07:12:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 247.191643] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:47 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 67 gitlab # [ 247.265603] gitaly[913]: time="2026-09-08T07:12:47.591Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSEXX1G61ENAXCPH168SN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.582" grpc.time_ms=9.036 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.267993] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:47 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 41 gitlab # [ 247.285761] gitaly[913]: time="2026-09-08T07:12:47.611Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:57.024" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:47.604" grpc.time_ms=6.848 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.310083] gitaly[913]: time="2026-09-08T07:12:47.635Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSEZ9G877Q07694BPPFQP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.625" pid=913 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 247.310759] gitaly[913]: time="2026-09-08T07:12:47.635Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1163 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSEZ9G877Q07694BPPFQP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.625" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.329663] gitaly[913]: time="2026-09-08T07:12:47.655Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1163 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSEZ9G877Q07694BPPFQP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.625" grpc.time_ms=29.438 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.344174] gitlab-workhorse[827]: time="2026-09-08T07:12:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 247.344936] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:47 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 76 gitlab # [ 247.350556] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:47.675Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c4f0bc78ac7cc4c8ed4a1a4f","created_at":"2026-09-08T07:12:47.670Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-3079c635910346bb","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.673Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c4f0bc78ac7cc4c8ed4a1a4f: start","job_status":"start","queue_duration_s":0.002343,"scheduling_latency_s":0.002377} gitlab # [ 247.363043] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:47 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 274 gitlab # [ 247.363913] nixbot[2656]: {"ts": "2026-09-08T07:12:47.689Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a \"HTTP/1.1 201 Created\""} gitlab # [ 247.412092] gitaly[913]: time="2026-09-08T07:12:47.737Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSF2CSX0B8WVBFM7JFGBZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:17.035" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:47.736" grpc.time_ms=0.572 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.429385] gitaly[913]: time="2026-09-08T07:12:47.755Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSF2VMVYJK3E2FWPV451N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:17.651" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:47.751" grpc.time_ms=3.197 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.444894] gitaly[913]: time="2026-09-08T07:12:47.770Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSF2CSX0B8WVBFM7JFGBZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:57.183" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:47.763" grpc.time_ms=6.15 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.461926] gitaly[913]: time="2026-09-08T07:12:47.787Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:47.786" grpc.time_ms=1.549 pid=913 span.kind=server system=grpc gitlab # [ 247.471647] gitaly[913]: time="2026-09-08T07:12:47.797Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSF2VMVYJK3E2FWPV451N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-08T07:13:17.684" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:47.784" grpc.time_ms=12.359 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.482265] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:47 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 115 gitlab # [ 247.483391] nixbot[2656]: {"ts": "2026-09-08T07:12:47.809Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a \"HTTP/1.1 201 Created\""} gitlab # [ 247.488774] gitaly[913]: time="2026-09-08T07:12:47.814Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSF2VMVYJK3E2FWPV451N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:57.086" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:47.807" grpc.time_ms=7.015 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.503918] gitaly[913]: time="2026-09-08T07:12:47.829Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSF2VMVYJK3E2FWPV451N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-08T07:12:57.108" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:12:47.828" grpc.time_ms=0.239 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.511356] gitaly[913]: time="2026-09-08T07:12:47.837Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSF2VMVYJK3E2FWPV451N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-08T07:12:57.111" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:47.831" grpc.time_ms=5.192 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.518942] gitaly[913]: time="2026-09-08T07:12:47.844Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:47.844" grpc.time_ms=0.211 pid=913 span.kind=server system=grpc gitlab # [ 247.539065] gitaly[913]: time="2026-09-08T07:12:47.864Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSF65R9D6TD6Z7X4EMRJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:17.163" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:47.864" grpc.time_ms=0.533 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.540925] gitaly[913]: time="2026-09-08T07:12:47.866Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSF2VMVYJK3E2FWPV451N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:47.866" grpc.time_ms=0.194 pid=913 span.kind=server system=grpc gitlab # [ 247.561075] gitaly[913]: time="2026-09-08T07:12:47.886Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:47.886" grpc.time_ms=0.313 pid=913 span.kind=server system=grpc gitlab # [ 247.573346] gitaly[913]: time="2026-09-08T07:12:47.899Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSF65R9D6TD6Z7X4EMRJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:12:57.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:47.886" grpc.time_ms=12.885 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.586102] gitaly[913]: time="2026-09-08T07:12:47.907Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME diskcache=53d66367-325a-4d72-a19c-3f1140245c10 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:17.764" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:47.764" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.586775] gitaly[913]: time="2026-09-08T07:12:47.908Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=85 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7191 command.oublock=0 command.real_time_ms=132 command.spawn_token_fork_ms=0 command.system_time_ms=65 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:17.764" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:47.764" grpc.time_ms=143.291 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.590146] gitaly[913]: time="2026-09-08T07:12:47.915Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSF2VMVYJK3E2FWPV451N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:47.913" grpc.time_ms=1.587 pid=913 span.kind=server system=grpc gitlab # [ 247.611136] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:47 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 122 gitlab # [ 247.611910] nixbot[2656]: {"ts": "2026-09-08T07:12:47.937Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c210e880bc7e1858923395a18a5aad313ef0848a \"HTTP/1.1 201 Created\""} gitlab # [ 247.627569] gitaly[913]: time="2026-09-08T07:12:47.953Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T07:13:17.452" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:47.952" grpc.time_ms=0.584 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.630171] gitaly[913]: time="2026-09-08T07:12:47.955Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSF2VMVYJK3E2FWPV451N diskcache=6c21108c-048e-4651-a0c3-51c72690a961 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T07:12:57.118" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:12:47.838" pid=913 ref=refs/keep-around/71d9770cc1955c24351c5f5ddaf2597e8921843b remote_ip="2001:db8:1::1" revision=71d9770cc1955c24351c5f5ddaf2597e8921843b span.kind=server system=grpc username=root gitlab # [ 247.630760] gitaly[913]: time="2026-09-08T07:12:47.956Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=52 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5106 command.oublock=8 command.real_time_ms=110 command.spawn_token_fork_ms=2 command.system_time_ms=32 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSF2VMVYJK3E2FWPV451N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T07:12:57.118" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T07:12:47.838" grpc.time_ms=117.185 pid=913 ref=refs/keep-around/71d9770cc1955c24351c5f5ddaf2597e8921843b remote_ip="2001:db8:1::1" revision=71d9770cc1955c24351c5f5ddaf2597e8921843b span.kind=server system=grpc username=root gitlab # [ 247.633665] gitaly[913]: time="2026-09-08T07:12:47.959Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSF2VMVYJK3E2FWPV451N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:17.858" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:47.959" grpc.time_ms=0.364 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.674506] gitaly[913]: time="2026-09-08T07:12:48.000Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSFATK9931SQ14JK8DCEV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:47.994" grpc.time_ms=5.664 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.675351] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 37 gitlab # [ 247.704053] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/71d9770cc1955c24351c5f5ddaf2597e8921843b HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 322 gitlab # [ 247.704785] nixbot[2656]: {"ts": "2026-09-08T07:12:48.030Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/71d9770cc1955c24351c5f5ddaf2597e8921843b \"HTTP/1.1 201 Created\""} gitlab # [ 247.716234] nixbot[2656]: {"ts": "2026-09-08T07:12:48.041Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-71d9770cc195-4"} gitlab # [ 247.726397] gitaly[913]: time="2026-09-08T07:12:48.052Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:18.049" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:48.050" grpc.time_ms=1.047 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.737726] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.063Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"025bdad60d5c51b3f78cf418","created_at":"2026-09-08T07:12:48.061Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"c4f0bc78ac7cc4c8ed4a1a4f","job_size_bytes":3,"pid":2532,"job_status":"deduplicated","message":"PipelineProcessWorker JID-025bdad60d5c51b3f78cf418: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 247.738534] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.064Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c4f0bc78ac7cc4c8ed4a1a4f","created_at":"2026-09-08T07:12:47.670Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-3079c635910346bb","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.673Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2532,"job_status":"rescheduled","message":"PipelineProcessWorker JID-c4f0bc78ac7cc4c8ed4a1a4f: rescheduled"} gitlab # [ 247.743044] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.068Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c4f0bc78ac7cc4c8ed4a1a4f","created_at":"2026-09-08T07:12:47.670Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-3079c635910346bb","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.673Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c4f0bc78ac7cc4c8ed4a1a4f: done: 0.39299 sec","job_status":"done","queue_duration_s":0.002343,"scheduling_latency_s":0.002377,"gitaly_calls":3,"gitaly_duration_s":0.197658,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.030562,"redis_read_bytes":226,"redis_write_bytes":18467,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.011131,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000665,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002042,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.003796,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000186,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000414,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001197,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091732,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.334041338,"duration_s":0.39299,"completed_at":"2026-09-08T07:12:48.068Z","load_balancing_strategy":"primary","db_duration_s":0.043005,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 247.771223] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.069Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a93b1792a1be5526a4b5db86","created_at":"2026-09-08T07:12:47.759Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.760Z","job_size_bytes":23,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a93b1792a1be5526a4b5db86: start","job_status":"start","queue_duration_s":0.309003,"scheduling_latency_s":0.30902} gitlab # [ 247.813399] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.104Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a93b1792a1be5526a4b5db86","created_at":"2026-09-08T07:12:47.759Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.760Z","job_size_bytes":23,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a93b1792a1be5526a4b5db86: done: 0.035017 sec","job_status":"done","queue_duration_s":0.309003,"scheduling_latency_s":0.30902,"redis_calls":7,"redis_duration_s":0.000984,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035017,"completed_at":"2026-09-08T07:12:48.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012831,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 247.855307] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.105Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"57c5ce274898afec0d263541","created_at":"2026-09-08T07:12:47.914Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.917Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-57c5ce274898afec0d263541: start","job_status":"start","queue_duration_s":0.188366,"scheduling_latency_s":0.188383} gitlab # [ 247.855991] nixbot[2656]: {"ts": "2026-09-08T07:12:48.128Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-71d9770cc195-4", "argv0": "bwrap"} gitlab # [ 247.856424] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.121Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"57c5ce274898afec0d263541","created_at":"2026-09-08T07:12:47.914Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.917Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-57c5ce274898afec0d263541: done: 0.015777 sec","job_status":"done","queue_duration_s":0.188366,"scheduling_latency_s":0.188383,"redis_calls":7,"redis_duration_s":0.000914,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015777,"completed_at":"2026-09-08T07:12:48.121Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002529,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.875948] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.122Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1e3d0d40dc4c075ecc1f63a6","created_at":"2026-09-08T07:12:47.922Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.924Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1e3d0d40dc4c075ecc1f63a6: start","job_status":"start","queue_duration_s":0.197922,"scheduling_latency_s":0.197936} gitlab # [ 247.889937] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.138Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1e3d0d40dc4c075ecc1f63a6","created_at":"2026-09-08T07:12:47.922Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.924Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1e3d0d40dc4c075ecc1f63a6: done: 0.016232 sec","job_status":"done","queue_duration_s":0.197922,"scheduling_latency_s":0.197936,"redis_calls":7,"redis_duration_s":0.000922,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016232,"completed_at":"2026-09-08T07:12:48.138Z","load_balancing_strategy":"primary","db_duration_s":0.002892,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b' gitlab # [ 247.935781] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.139Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"059dd427124e7cf6629f00ff","created_at":"2026-09-08T07:12:47.929Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.931Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-059dd427124e7cf6629f00ff: start","job_status":"start","queue_duration_s":0.208006,"scheduling_latency_s":0.208021} gitlab # [ 247.940823] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.157Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"059dd427124e7cf6629f00ff","created_at":"2026-09-08T07:12:47.929Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.931Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-059dd427124e7cf6629f00ff: done: 0.01821 sec","job_status":"done","queue_duration_s":0.208006,"scheduling_latency_s":0.208021,"redis_calls":10,"redis_duration_s":0.001364,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000699,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000392,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01821,"completed_at":"2026-09-08T07:12:48.157Z","load_balancing_strategy":"primary","db_duration_s":0.003402,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.015232] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.158Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"95d20ab3343ec0d0ecdce0f9","created_at":"2026-09-08T07:12:47.931Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.933Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-95d20ab3343ec0d0ecdce0f9: start","job_status":"start","queue_duration_s":0.225077,"scheduling_latency_s":0.225092} gitlab # [ 248.015903] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.172Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"95d20ab3343ec0d0ecdce0f9","created_at":"2026-09-08T07:12:47.931Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.933Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-95d20ab3343ec0d0ecdce0f9: done: 0.014243 sec","job_status":"done","queue_duration_s":0.225077,"scheduling_latency_s":0.225092,"redis_calls":7,"redis_duration_s":0.001005,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014243,"completed_at":"2026-09-08T07:12:48.172Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00222,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.030600] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.173Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a5cdb227cf753500b6baaf0b","created_at":"2026-09-08T07:12:47.933Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.935Z","job_size_bytes":19,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a5cdb227cf753500b6baaf0b: start","job_status":"start","queue_duration_s":0.238138,"scheduling_latency_s":0.238153} gitlab # [ 248.068843] gitaly[913]: time="2026-09-08T07:12:48.341Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSF2VMVYJK3E2FWPV451N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T07:13:18.339" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:48.340" grpc.time_ms=0.903 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.069651] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.189Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a5cdb227cf753500b6baaf0b","created_at":"2026-09-08T07:12:47.933Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.935Z","job_size_bytes":19,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a5cdb227cf753500b6baaf0b: done: 0.016073 sec","job_status":"done","queue_duration_s":0.238138,"scheduling_latency_s":0.238153,"redis_calls":8,"redis_duration_s":0.001452,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001166,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016073,"completed_at":"2026-09-08T07:12:48.189Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.120050] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.190Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b4f2a2d21deb7d11bd38fd9f","created_at":"2026-09-08T07:12:47.936Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.937Z","job_size_bytes":66,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b4f2a2d21deb7d11bd38fd9f: start","job_status":"start","queue_duration_s":0.253328,"scheduling_latency_s":0.253343} gitlab # [ 248.120708] gitaly[913]: time="2026-09-08T07:12:48.364Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSF2VMVYJK3E2FWPV451N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:18.363" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:48.363" grpc.time_ms=0.506 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.121456] gitaly[913]: time="2026-09-08T07:12:48.433Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:48.431" grpc.time_ms=0.933 pid=913 span.kind=server system=grpc gitlab # [ 248.127578] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.203Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b4f2a2d21deb7d11bd38fd9f","created_at":"2026-09-08T07:12:47.936Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.937Z","job_size_bytes":66,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b4f2a2d21deb7d11bd38fd9f: done: 0.012664 sec","job_status":"done","queue_duration_s":0.253328,"scheduling_latency_s":0.253343,"redis_calls":7,"redis_duration_s":0.000928,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012664,"completed_at":"2026-09-08T07:12:48.203Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.167659] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.204Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"cee23108432ce13212ae4a68","created_at":"2026-09-08T07:12:47.937Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.938Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-cee23108432ce13212ae4a68: start","job_status":"start","queue_duration_s":0.265766,"scheduling_latency_s":0.265778} gitlab # [ 248.206858] gitaly[913]: time="2026-09-08T07:12:48.452Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:48.452" grpc.time_ms=0.272 pid=913 span.kind=server system=grpc gitlab # [ 248.207554] gitaly[913]: time="2026-09-08T07:12:48.471Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:48.471" grpc.time_ms=0.242 pid=913 span.kind=server system=grpc gitlab # [ 248.208087] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.219Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"cee23108432ce13212ae4a68","created_at":"2026-09-08T07:12:47.937Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.938Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-cee23108432ce13212ae4a68: done: 0.015537 sec","job_status":"done","queue_duration_s":0.265766,"scheduling_latency_s":0.265778,"redis_calls":7,"redis_duration_s":0.0009209999999999999,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015537,"completed_at":"2026-09-08T07:12:48.219Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003786,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.260575] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.220Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"de6bb8963abeb581e76159fa","created_at":"2026-09-08T07:12:47.938Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.939Z","job_size_bytes":6,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-de6bb8963abeb581e76159fa: start","job_status":"start","queue_duration_s":0.280976,"scheduling_latency_s":0.28099} gitlab # [ 248.261771] gitaly[913]: time="2026-09-08T07:12:48.474Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:18.411" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:48.411" operations="[repack_refs]" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.262565] gitaly[913]: time="2026-09-08T07:12:48.476Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:18.411" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:48.411" pid=913 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-08 07:11:51.321638203 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 248.267836] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.228Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"de6bb8963abeb581e76159fa","created_at":"2026-09-08T07:12:47.938Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.939Z","job_size_bytes":6,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-de6bb8963abeb581e76159fa: done: 0.008147 sec","job_status":"done","queue_duration_s":0.280976,"scheduling_latency_s":0.28099,"redis_calls":7,"redis_duration_s":0.0008669999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008147,"completed_at":"2026-09-08T07:12:48.228Z","load_balancing_strategy":"primary","db_duration_s":0.000236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.310608] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.229Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"2117f6d1b3d8bdc90041119f","created_at":"2026-09-08T07:12:47.939Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.940Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2117f6d1b3d8bdc90041119f: start","job_status":"start","queue_duration_s":0.288838,"scheduling_latency_s":0.288851} gitlab # [ 248.317648] gitaly[913]: time="2026-09-08T07:12:48.481Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME diskcache=bb81e50a-4931-4537-87f2-cdc75567d753 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:18.411" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:48.411" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.326411] gitaly[913]: time="2026-09-08T07:12:48.481Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=71 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7480 command.oublock=0 command.real_time_ms=64 command.spawn_token_fork_ms=0 command.system_time_ms=48 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:18.411" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:48.411" grpc.time_ms=69.587 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.374132] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.242Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"2117f6d1b3d8bdc90041119f","created_at":"2026-09-08T07:12:47.939Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.940Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2117f6d1b3d8bdc90041119f: done: 0.012904 sec","job_status":"done","queue_duration_s":0.288838,"scheduling_latency_s":0.288851,"redis_calls":7,"redis_duration_s":0.000925,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012904,"completed_at":"2026-09-08T07:12:48.242Z","load_balancing_strategy":"primary","db_duration_s":0.001856,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.375048] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.243Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"a6014a75a1a24bb53ca70d2e","created_at":"2026-09-08T07:12:47.960Z","trace_propagation_headers":{"sentry-trace":"8534c9372c044bbca78d0c509616650d-57639aa467ce41c3","baggage":"sentry-trace_id=8534c9372c044bbca78d0c509616650d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXSF2VMVYJK3E2FWPV451N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.962Z","job_size_bytes":65,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-a6014a75a1a24bb53ca70d2e: start","job_status":"start","queue_duration_s":0.280533,"scheduling_latency_s":0.280547} gitlab # [ 248.414319] gitaly[913]: time="2026-09-08T07:12:48.491Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:18.411" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:48.411" pid=913 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 248.414962] gitaly[913]: time="2026-09-08T07:12:48.491Z" level=info msg="optimized repository" clean_stale_data_time=15.074262ms clean_work_trees_time="88.279µs" commit_graph_time="3.632µs" correlation_id=01M1ZXSESND0CVWN1WXWYH4JME gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=913 prune_time="3.632µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.469µs" storage_name=default system=housekeeping total_time=15.293564ms gitlab # [ 248.415571] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.259Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"a6014a75a1a24bb53ca70d2e","created_at":"2026-09-08T07:12:47.960Z","trace_propagation_headers":{"sentry-trace":"8534c9372c044bbca78d0c509616650d-57639aa467ce41c3","baggage":"sentry-trace_id=8534c9372c044bbca78d0c509616650d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXSF2VMVYJK3E2FWPV451N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.962Z","job_size_bytes":65,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-a6014a75a1a24bb53ca70d2e: done: 0.015995 sec","job_status":"done","queue_duration_s":0.280533,"scheduling_latency_s":0.280547,"redis_calls":7,"redis_duration_s":0.0010119999999999999,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000339,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015995,"completed_at":"2026-09-08T07:12:48.259Z","load_balancing_strategy":"primary","db_duration_s":0.002547,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.459697] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.260Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"9b2d648fdb03293dd19d329e","created_at":"2026-09-08T07:12:47.963Z","trace_propagation_headers":{"sentry-trace":"8534c9372c044bbca78d0c509616650d-57639aa467ce41c3","baggage":"sentry-trace_id=8534c9372c044bbca78d0c509616650d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXSF2VMVYJK3E2FWPV451N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.964Z","job_size_bytes":65,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-9b2d648fdb03293dd19d329e: start","job_status":"start","queue_duration_s":0.295426,"scheduling_latency_s":0.29544} gitlab # [ 248.460487] gitaly[913]: time="2026-09-08T07:12:48.491Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:18.411" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:48.411" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.499412] gitaly[913]: time="2026-09-08T07:12:48.514Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T07:13:18.513" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:48.513" grpc.time_ms=0.718 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.500175] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.295Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"9b2d648fdb03293dd19d329e","created_at":"2026-09-08T07:12:47.963Z","trace_propagation_headers":{"sentry-trace":"8534c9372c044bbca78d0c509616650d-57639aa467ce41c3","baggage":"sentry-trace_id=8534c9372c044bbca78d0c509616650d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXSF2VMVYJK3E2FWPV451N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:47.964Z","job_size_bytes":65,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-9b2d648fdb03293dd19d329e: done: 0.035192 sec","job_status":"done","queue_duration_s":0.295426,"scheduling_latency_s":0.29544,"redis_calls":10,"redis_duration_s":0.0013180000000000002,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000622,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035192,"completed_at":"2026-09-08T07:12:48.295Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013181,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.551621] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.296Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"dbd7fe723ec27a7cd0c0720a","created_at":"2026-09-08T07:12:48.017Z","trace_propagation_headers":{"sentry-trace":"8534c9372c044bbca78d0c509616650d-57639aa467ce41c3","baggage":"sentry-trace_id=8534c9372c044bbca78d0c509616650d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXSF2VMVYJK3E2FWPV451N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.019Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dbd7fe723ec27a7cd0c0720a: start","job_status":"start","queue_duration_s":0.276896,"scheduling_latency_s":0.276911} gitlab # [ 248.552551] gitaly[913]: time="2026-09-08T07:12:48.532Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSESND0CVWN1WXWYH4JME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:18.531" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:48.531" grpc.time_ms=0.493 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.553206] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.371Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"dbd7fe723ec27a7cd0c0720a","created_at":"2026-09-08T07:12:48.017Z","trace_propagation_headers":{"sentry-trace":"8534c9372c044bbca78d0c509616650d-57639aa467ce41c3","baggage":"sentry-trace_id=8534c9372c044bbca78d0c509616650d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXSF2VMVYJK3E2FWPV451N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.019Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dbd7fe723ec27a7cd0c0720a: done: 0.074923 sec","job_status":"done","queue_duration_s":0.276896,"scheduling_latency_s":0.276911,"gitaly_calls":2,"gitaly_duration_s":0.004957,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004331,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000826,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000644,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.00017,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000146,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000254,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050267,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.057246941,"duration_s":0.074923,"completed_at":"2026-09-08T07:12:48.371Z","load_balancing_strategy":"primary","db_duration_s":0.018683,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.607650] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.372Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7bfa7284112e4a15775259ac","created_at":"2026-09-08T07:12:48.064Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.065Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7bfa7284112e4a15775259ac: start","job_status":"start","queue_duration_s":0.306988,"scheduling_latency_s":0.307001} gitlab # [ 248.607968] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.547Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7bfa7284112e4a15775259ac","created_at":"2026-09-08T07:12:48.064Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-84bae699d3544f1a","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.065Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7bfa7284112e4a15775259ac: done: 0.175618 sec","job_status":"done","queue_duration_s":0.306988,"scheduling_latency_s":0.307001,"gitaly_calls":3,"gitaly_duration_s":0.078848,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.010675,"redis_read_bytes":142,"redis_write_bytes":16715,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000318,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000528,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.001605,"redis_queues_read_bytes":22,"redis_queues_write_bytes":11221,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.004688,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00014,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00033,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002748,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068514,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15188327,"duration_s":0.175618,"completed_at":"2026-09-08T07:12:48.547Z","load_balancing_strategy":"primary","db_duration_s":0.022594,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.653733] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.549Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a97cc1422f8c46972bfdfe7d","created_at":"2026-09-08T07:12:48.330Z","trace_propagation_headers":{"sentry-trace":"8534c9372c044bbca78d0c509616650d-72b32ce953a245f5","baggage":"sentry-trace_id=8534c9372c044bbca78d0c509616650d,sentry-release=Unknown"},"correlation_id":"01M1ZXSF2VMVYJK3E2FWPV451N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.331Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a97cc1422f8c46972bfdfe7d: start","job_status":"start","queue_duration_s":0.217637,"scheduling_latency_s":0.217652} gitlab # [ 248.658795] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.568Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a97cc1422f8c46972bfdfe7d","created_at":"2026-09-08T07:12:48.330Z","trace_propagation_headers":{"sentry-trace":"8534c9372c044bbca78d0c509616650d-72b32ce953a245f5","baggage":"sentry-trace_id=8534c9372c044bbca78d0c509616650d,sentry-release=Unknown"},"correlation_id":"01M1ZXSF2VMVYJK3E2FWPV451N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.331Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a97cc1422f8c46972bfdfe7d: done: 0.019404 sec","job_status":"done","queue_duration_s":0.217637,"scheduling_latency_s":0.217652,"redis_calls":7,"redis_duration_s":0.000915,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019404,"completed_at":"2026-09-08T07:12:48.568Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.704671] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.569Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c3e5ae343000ac3199317669","created_at":"2026-09-08T07:12:48.407Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.408Z","job_size_bytes":23,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c3e5ae343000ac3199317669: start","job_status":"start","queue_duration_s":0.160979,"scheduling_latency_s":0.160994} gitlab # [ 248.745229] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.595Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c3e5ae343000ac3199317669","created_at":"2026-09-08T07:12:48.407Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.408Z","job_size_bytes":23,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c3e5ae343000ac3199317669: done: 0.025937 sec","job_status":"done","queue_duration_s":0.160979,"scheduling_latency_s":0.160994,"redis_calls":7,"redis_duration_s":0.000933,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025937,"completed_at":"2026-09-08T07:12:48.595Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007427,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.747140] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.596Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"aad84b4364e988220bad91dc","created_at":"2026-09-08T07:12:48.485Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.487Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-aad84b4364e988220bad91dc: start","job_status":"start","queue_duration_s":0.108383,"scheduling_latency_s":0.108397} gitlab # [ 248.790693] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.611Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"aad84b4364e988220bad91dc","created_at":"2026-09-08T07:12:48.485Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.487Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-aad84b4364e988220bad91dc: done: 0.015118 sec","job_status":"done","queue_duration_s":0.108383,"scheduling_latency_s":0.108397,"redis_calls":7,"redis_duration_s":0.000889,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015118,"completed_at":"2026-09-08T07:12:48.611Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002325,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.799534] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.612Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"06a520c022fab267efc62a1a","created_at":"2026-09-08T07:12:48.492Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.493Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-06a520c022fab267efc62a1a: start","job_status":"start","queue_duration_s":0.118338,"scheduling_latency_s":0.118353} gitlab # [ 248.839985] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.627Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"06a520c022fab267efc62a1a","created_at":"2026-09-08T07:12:48.492Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.493Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-06a520c022fab267efc62a1a: done: 0.015462 sec","job_status":"done","queue_duration_s":0.118338,"scheduling_latency_s":0.118353,"redis_calls":7,"redis_duration_s":0.000905,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015462,"completed_at":"2026-09-08T07:12:48.627Z","load_balancing_strategy":"primary","db_duration_s":0.002468,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.881483] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.628Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b9f910f4930e67e492243497","created_at":"2026-09-08T07:12:48.498Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.499Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b9f910f4930e67e492243497: start","job_status":"start","queue_duration_s":0.129235,"scheduling_latency_s":0.129248} gitlab # [ 248.882164] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.646Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b9f910f4930e67e492243497","created_at":"2026-09-08T07:12:48.498Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.499Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b9f910f4930e67e492243497: done: 0.017968 sec","job_status":"done","queue_duration_s":0.129235,"scheduling_latency_s":0.129248,"redis_calls":10,"redis_duration_s":0.001222,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000616,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000349,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017968,"completed_at":"2026-09-08T07:12:48.646Z","load_balancing_strategy":"primary","db_duration_s":0.003633,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.929223] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.647Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"fafe9caa40c1c7ffcefdeb3d","created_at":"2026-09-08T07:12:48.499Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.500Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-fafe9caa40c1c7ffcefdeb3d: start","job_status":"start","queue_duration_s":0.146863,"scheduling_latency_s":0.146879} gitlab # [ 248.929965] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.661Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"fafe9caa40c1c7ffcefdeb3d","created_at":"2026-09-08T07:12:48.499Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.500Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-fafe9caa40c1c7ffcefdeb3d: done: 0.014181 sec","job_status":"done","queue_duration_s":0.146863,"scheduling_latency_s":0.146879,"redis_calls":7,"redis_duration_s":0.0009,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014181,"completed_at":"2026-09-08T07:12:48.661Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.969933] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.662Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1ef97c6ea5259e55f67f467f","created_at":"2026-09-08T07:12:48.500Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.502Z","job_size_bytes":19,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1ef97c6ea5259e55f67f467f: start","job_status":"start","queue_duration_s":0.160356,"scheduling_latency_s":0.160371} gitlab # [ 248.970695] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.675Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1ef97c6ea5259e55f67f467f","created_at":"2026-09-08T07:12:48.500Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.502Z","job_size_bytes":19,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1ef97c6ea5259e55f67f467f: done: 0.01351 sec","job_status":"done","queue_duration_s":0.160356,"scheduling_latency_s":0.160371,"redis_calls":8,"redis_duration_s":0.001018,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01351,"completed_at":"2026-09-08T07:12:48.675Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00209,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.027718] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.676Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e641eb35626cfd766161da2a","created_at":"2026-09-08T07:12:48.502Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.503Z","job_size_bytes":66,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e641eb35626cfd766161da2a: start","job_status":"start","queue_duration_s":0.173179,"scheduling_latency_s":0.173194} gitlab # [ 249.028592] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.689Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e641eb35626cfd766161da2a","created_at":"2026-09-08T07:12:48.502Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.503Z","job_size_bytes":66,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e641eb35626cfd766161da2a: done: 0.012373 sec","job_status":"done","queue_duration_s":0.173179,"scheduling_latency_s":0.173194,"redis_calls":7,"redis_duration_s":0.00084,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00061,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012373,"completed_at":"2026-09-08T07:12:48.689Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.073715] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.689Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"17123a3ea90ec44b461a7677","created_at":"2026-09-08T07:12:48.503Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.504Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-17123a3ea90ec44b461a7677: start","job_status":"start","queue_duration_s":0.185266,"scheduling_latency_s":0.18528} gitlab # [ 249.074616] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.708Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"17123a3ea90ec44b461a7677","created_at":"2026-09-08T07:12:48.503Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.504Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-17123a3ea90ec44b461a7677: done: 0.018529 sec","job_status":"done","queue_duration_s":0.185266,"scheduling_latency_s":0.18528,"redis_calls":7,"redis_duration_s":0.001062,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018529,"completed_at":"2026-09-08T07:12:48.708Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.128833] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.709Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5bcd66b637950d9c4dacb78f","created_at":"2026-09-08T07:12:48.505Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.505Z","job_size_bytes":6,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5bcd66b637950d9c4dacb78f: start","job_status":"start","queue_duration_s":0.203779,"scheduling_latency_s":0.203797} gitlab # [ 249.129642] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.718Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5bcd66b637950d9c4dacb78f","created_at":"2026-09-08T07:12:48.505Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.505Z","job_size_bytes":6,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5bcd66b637950d9c4dacb78f: done: 0.009358 sec","job_status":"done","queue_duration_s":0.203779,"scheduling_latency_s":0.203797,"redis_calls":7,"redis_duration_s":0.000894,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009358,"completed_at":"2026-09-08T07:12:48.718Z","load_balancing_strategy":"primary","db_duration_s":0.000384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.158626] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.719Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"bf12493bfedf932b443d7cdd","created_at":"2026-09-08T07:12:48.506Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.506Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-bf12493bfedf932b443d7cdd: start","job_status":"start","queue_duration_s":0.21282,"scheduling_latency_s":0.212832} gitlab # [ 249.209046] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:48.733Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"bf12493bfedf932b443d7cdd","created_at":"2026-09-08T07:12:48.506Z","trace_propagation_headers":{"sentry-trace":"92b07f9108c348a19260ad1360672a75-01c218dc0e414a01","baggage":"sentry-trace_id=92b07f9108c348a19260ad1360672a75,sentry-release=Unknown"},"correlation_id":"01M1ZXSESND0CVWN1WXWYH4JME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:48.506Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-bf12493bfedf932b443d7cdd: done: 0.013724 sec","job_status":"done","queue_duration_s":0.21282,"scheduling_latency_s":0.212832,"redis_calls":7,"redis_duration_s":0.0008539999999999999,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000618,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013724,"completed_at":"2026-09-08T07:12:48.733Z","load_balancing_strategy":"primary","db_duration_s":0.002114,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.264715] nixbot[2656]: INFO: ::ffff:127.0.0.1:49862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=71d9770cc1955c24351c5f5ddaf2597e8921843b', in 1.32 seconds) gitlab # [ 249.278507] gitaly[913]: time="2026-09-08T07:12:49.604Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSFCEQ0DHA8C7DZ064VDM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:49.597" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc (finished: subtest: push delivers the webhook, in 47.89 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses gitlab # [ 249.279461] gitaly[913]: time="2026-09-08T07:12:49.604Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSFCEQ0DHA8C7DZ064VDM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:49.597" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 249.297914] gitaly[913]: time="2026-09-08T07:12:49.623Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSFCEQ0DHA8C7DZ064VDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:49.597" grpc.time_ms=25.814 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 249.311356] gitlab-workhorse[827]: time="2026-09-08T07:12:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 249.311764] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1622 gitlab # [ 249.327323] nix-daemon[2821]: accepted connection from pid 3636, user nixbot gitlab # [ 249.366191] gitaly[913]: time="2026-09-08T07:12:49.691Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSGZSVRRZCKQ8P9ABY0SF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:19.290" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:49.691" grpc.time_ms=0.643 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.388790] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 56 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses, in 0.10 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses gitlab # [ 250.460511] gitaly[913]: time="2026-09-08T07:12:50.785Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSJ1S75QHFAJMGDSEN3WB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:20.684" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:50.784" grpc.time_ms=0.897 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.526109] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 105 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses, in 0.14 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses gitlab # [ 251.652262] gitaly[913]: time="2026-09-08T07:12:51.977Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSK5P6Y43XE5JJ9A3MA4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:21.875" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:51.975" grpc.time_ms=0.8 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 251.670079] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 100 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses, in 0.15 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses gitlab # [ 252.775859] gitaly[913]: time="2026-09-08T07:12:53.100Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSM9PSWN960NY7WNN8AR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:23.099" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:53.099" grpc.time_ms=0.974 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 252.802492] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 81 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses, in 0.12 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses gitlab # [ 253.906673] gitaly[913]: time="2026-09-08T07:12:54.231Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSNCTH2TNB45T68SATFNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:24.129" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:54.230" grpc.time_ms=0.993 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.956189] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 109 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses, in 0.15 seconds) gitlab # [ 253.986379] nix-daemon[2821]: accepted connection from pid 3694, user nixbot gitlab # [ 253.999394] nix-daemon[2821]: accepted connection from pid 3636, user nixbot gitlab # [ 254.174197] gitaly[913]: time="2026-09-08T07:12:54.499Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:24.398" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:54.498" grpc.time_ms=0.829 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.235578] gitaly[913]: time="2026-09-08T07:12:54.561Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:13:04.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:54.549" grpc.time_ms=11.338 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.291526] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:54.616Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"45ebeb499dd53f594257170c","created_at":"2026-09-08T07:12:54.609Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-db9404e8f2984210","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.614Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-45ebeb499dd53f594257170c: start","job_status":"start","queue_duration_s":0.001812,"scheduling_latency_s":0.001859} gitlab # [ 254.342143] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/71d9770cc1955c24351c5f5ddaf2597e8921843b HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 302 gitlab # [ 254.344719] nixbot[2656]: {"ts": "2026-09-08T07:12:54.669Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/71d9770cc1955c24351c5f5ddaf2597e8921843b \"HTTP/1.1 201 Created\""} gitlab # [ 254.398331] gitaly[913]: time="2026-09-08T07:12:54.723Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:54.722" grpc.time_ms=1.239 pid=913 span.kind=server system=grpc gitlab # [ 254.415336] gitaly[913]: time="2026-09-08T07:12:54.734Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSNWJKVP6CAVSW6JHG2QF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:24.033" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:54.734" grpc.time_ms=0.526 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.437735] gitaly[913]: time="2026-09-08T07:12:54.763Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSNWJKVP6CAVSW6JHG2QF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:13:04.175" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:54.755" grpc.time_ms=7.789 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.457137] gitaly[913]: time="2026-09-08T07:12:54.782Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:54.782" grpc.time_ms=0.314 pid=913 span.kind=server system=grpc gitlab # [ 254.484508] gitaly[913]: time="2026-09-08T07:12:54.810Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:54.809" grpc.time_ms=0.228 pid=913 span.kind=server system=grpc gitlab # [ 254.489824] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/71d9770cc1955c24351c5f5ddaf2597e8921843b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 140 gitlab # [ 254.490843] nixbot[2656]: {"ts": "2026-09-08T07:12:54.816Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/71d9770cc1955c24351c5f5ddaf2597e8921843b \"HTTP/1.1 201 Created\""} gitlab # [ 254.505250] gitaly[913]: time="2026-09-08T07:12:54.830Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN diskcache=7a6f997b-180e-4d0f-992b-4c068ebfb238 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:24.701" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:54.701" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.514188] gitaly[913]: time="2026-09-08T07:12:54.831Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=90 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7031 command.oublock=0 command.real_time_ms=122 command.spawn_token_fork_ms=0 command.system_time_ms=63 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:24.701" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:54.701" grpc.time_ms=129.536 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.543554] gitaly[913]: time="2026-09-08T07:12:54.869Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSP1C51Y0K5V40XB85YE4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:24.168" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:54.868" grpc.time_ms=0.451 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.561351] gitaly[913]: time="2026-09-08T07:12:54.887Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T07:13:24.885" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:54.886" grpc.time_ms=0.728 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.570230] gitaly[913]: time="2026-09-08T07:12:54.895Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSP1C51Y0K5V40XB85YE4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T07:13:04.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:54.890" grpc.time_ms=5.923 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.598160] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/71d9770cc1955c24351c5f5ddaf2597e8921843b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 95 gitlab # [ 254.600769] nixbot[2656]: {"ts": "2026-09-08T07:12:54.924Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/71d9770cc1955c24351c5f5ddaf2597e8921843b \"HTTP/1.1 201 Created\""} gitlab # [ 254.607144] gitaly[913]: time="2026-09-08T07:12:54.932Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:24.431" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:54.932" grpc.time_ms=0.469 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.625286] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:54.950Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"35646b5209a92f1b491cab37","created_at":"2026-09-08T07:12:54.949Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"45ebeb499dd53f594257170c","job_size_bytes":3,"pid":2532,"job_status":"deduplicated","message":"PipelineProcessWorker JID-35646b5209a92f1b491cab37: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 254.639378] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:54.952Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"45ebeb499dd53f594257170c","created_at":"2026-09-08T07:12:54.609Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-db9404e8f2984210","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.614Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2532,"job_status":"rescheduled","message":"PipelineProcessWorker JID-45ebeb499dd53f594257170c: rescheduled"} gitlab # [ 254.640093] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:54.956Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"45ebeb499dd53f594257170c","created_at":"2026-09-08T07:12:54.609Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-db9404e8f2984210","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.614Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-45ebeb499dd53f594257170c: done: 0.34071 sec","job_status":"done","queue_duration_s":0.001812,"scheduling_latency_s":0.001859,"gitaly_calls":3,"gitaly_duration_s":0.171157,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.025500000000000002,"redis_read_bytes":239,"redis_write_bytes":21780,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001065,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001221,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003851,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14465,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.00419,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000293,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000713,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.013102,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.013,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.130793,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.306408776,"duration_s":0.34071,"completed_at":"2026-09-08T07:12:54.956Z","load_balancing_strategy":"primary","db_duration_s":0.041272,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 254.694968] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:54.957Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b5ebb3bd8611016fbbabf18c","created_at":"2026-09-08T07:12:54.690Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.693Z","job_size_bytes":23,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b5ebb3bd8611016fbbabf18c: start","job_status":"start","queue_duration_s":0.263505,"scheduling_latency_s":0.26352} gitlab # [ 254.695628] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:54.986Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b5ebb3bd8611016fbbabf18c","created_at":"2026-09-08T07:12:54.690Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.693Z","job_size_bytes":23,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b5ebb3bd8611016fbbabf18c: done: 0.028686 sec","job_status":"done","queue_duration_s":0.263505,"scheduling_latency_s":0.26352,"redis_calls":7,"redis_duration_s":0.001186,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028686,"completed_at":"2026-09-08T07:12:54.986Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004844,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 254.738176] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:54.987Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4ef521902943497436124445","created_at":"2026-09-08T07:12:54.835Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.837Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4ef521902943497436124445: start","job_status":"start","queue_duration_s":0.149801,"scheduling_latency_s":0.14982} gitlab # [ 254.738748] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.004Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4ef521902943497436124445","created_at":"2026-09-08T07:12:54.835Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.837Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4ef521902943497436124445: done: 0.017026 sec","job_status":"done","queue_duration_s":0.149801,"scheduling_latency_s":0.14982,"redis_calls":7,"redis_duration_s":0.000926,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017026,"completed_at":"2026-09-08T07:12:55.004Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002859,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.787302] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.005Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"880894d1195fa0bd3addd686","created_at":"2026-09-08T07:12:54.854Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.857Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-880894d1195fa0bd3addd686: start","job_status":"start","queue_duration_s":0.148177,"scheduling_latency_s":0.14819} gitlab # [ 254.787894] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.021Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"880894d1195fa0bd3addd686","created_at":"2026-09-08T07:12:54.854Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.857Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-880894d1195fa0bd3addd686: done: 0.016685 sec","job_status":"done","queue_duration_s":0.148177,"scheduling_latency_s":0.14819,"redis_calls":7,"redis_duration_s":0.000992,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016685,"completed_at":"2026-09-08T07:12:55.021Z","load_balancing_strategy":"primary","db_duration_s":0.003037,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.837661] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.025Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"647515acc54be0f061cadde0","created_at":"2026-09-08T07:12:54.863Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.864Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-647515acc54be0f061cadde0: start","job_status":"start","queue_duration_s":0.160851,"scheduling_latency_s":0.160866} gitlab # [ 254.838464] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.043Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"647515acc54be0f061cadde0","created_at":"2026-09-08T07:12:54.863Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.864Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-647515acc54be0f061cadde0: done: 0.018559 sec","job_status":"done","queue_duration_s":0.160851,"scheduling_latency_s":0.160866,"redis_calls":10,"redis_duration_s":0.00178,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000829,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018559,"completed_at":"2026-09-08T07:12:55.043Z","load_balancing_strategy":"primary","db_duration_s":0.002886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.866986] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.044Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"495fe32e9f1c78fa48b06969","created_at":"2026-09-08T07:12:54.864Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.865Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-495fe32e9f1c78fa48b06969: start","job_status":"start","queue_duration_s":0.179045,"scheduling_latency_s":0.179059} gitlab # [ 254.913740] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.059Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"495fe32e9f1c78fa48b06969","created_at":"2026-09-08T07:12:54.864Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.865Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-495fe32e9f1c78fa48b06969: done: 0.014645 sec","job_status":"done","queue_duration_s":0.179045,"scheduling_latency_s":0.179059,"redis_calls":7,"redis_duration_s":0.000908,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000227,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014645,"completed_at":"2026-09-08T07:12:55.059Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002223,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses gitlab # [ 254.919446] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.060Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"eb2c5112620149a4dd1da67e","created_at":"2026-09-08T07:12:54.865Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.867Z","job_size_bytes":19,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-eb2c5112620149a4dd1da67e: start","job_status":"start","queue_duration_s":0.193059,"scheduling_latency_s":0.193073} gitlab # [ 254.969984] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.079Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"eb2c5112620149a4dd1da67e","created_at":"2026-09-08T07:12:54.865Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.867Z","job_size_bytes":19,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-eb2c5112620149a4dd1da67e: done: 0.019568 sec","job_status":"done","queue_duration_s":0.193059,"scheduling_latency_s":0.193073,"redis_calls":8,"redis_duration_s":0.004196,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003953,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019568,"completed_at":"2026-09-08T07:12:55.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004199,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.971583] gitaly[913]: time="2026-09-08T07:12:55.228Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:55.228" grpc.time_ms=0.393 pid=913 span.kind=server system=grpc gitlab # [ 254.979677] gitaly[913]: time="2026-09-08T07:12:55.246Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:55.245" grpc.time_ms=0.355 pid=913 span.kind=server system=grpc gitlab # [ 254.988464] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.080Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a851ced08ff118009c4e74e6","created_at":"2026-09-08T07:12:54.867Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.868Z","job_size_bytes":66,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a851ced08ff118009c4e74e6: start","job_status":"start","queue_duration_s":0.211964,"scheduling_latency_s":0.211979} gitlab # [ 255.003640] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.094Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a851ced08ff118009c4e74e6","created_at":"2026-09-08T07:12:54.867Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.868Z","job_size_bytes":66,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a851ced08ff118009c4e74e6: done: 0.013472 sec","job_status":"done","queue_duration_s":0.211964,"scheduling_latency_s":0.211979,"redis_calls":7,"redis_duration_s":0.001543,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013472,"completed_at":"2026-09-08T07:12:55.094Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001488,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.046261] gitaly[913]: time="2026-09-08T07:12:55.265Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T07:12:55.264" grpc.time_ms=0.992 pid=913 span.kind=server system=grpc gitlab # [ 255.049735] gitaly[913]: time="2026-09-08T07:12:55.273Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN diskcache=923bb670-8f0a-4f31-9ddf-3ed47dcd4040 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:25.209" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:55.209" pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.087743] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.095Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"db804c4018a186dd633ef903","created_at":"2026-09-08T07:12:54.869Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.870Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-db804c4018a186dd633ef903: start","job_status":"start","queue_duration_s":0.224747,"scheduling_latency_s":0.22476} gitlab # [ 255.088558] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.118Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"db804c4018a186dd633ef903","created_at":"2026-09-08T07:12:54.869Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.870Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-db804c4018a186dd633ef903: done: 0.023355 sec","job_status":"done","queue_duration_s":0.224747,"scheduling_latency_s":0.22476,"redis_calls":7,"redis_duration_s":0.004841,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001257,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003584,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023355,"completed_at":"2026-09-08T07:12:55.118Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002694,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.127546] gitaly[913]: time="2026-09-08T07:12:55.274Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=67 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7395 command.oublock=0 command.real_time_ms=58 command.spawn_token_fork_ms=0 command.system_time_ms=35 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T07:13:25.209" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T07:12:55.209" grpc.time_ms=64.562 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.128407] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.121Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"95bee256938477f398d9dedd","created_at":"2026-09-08T07:12:54.873Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.874Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-95bee256938477f398d9dedd: start","job_status":"start","queue_duration_s":0.246231,"scheduling_latency_s":0.246248} gitlab # [ 255.135609] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.143Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"95bee256938477f398d9dedd","created_at":"2026-09-08T07:12:54.873Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.874Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-95bee256938477f398d9dedd: done: 0.021891 sec","job_status":"done","queue_duration_s":0.246231,"scheduling_latency_s":0.246248,"redis_calls":7,"redis_duration_s":0.0019399999999999999,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000772,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021891,"completed_at":"2026-09-08T07:12:55.142Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004321,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses, in 0.26 seconds) (finished: subtest: eval and build post commit statuses, in 5.93 seconds) (finished: run the VM test script, in 315.82 seconds) gitlab # [ 255.176132] gitaly[913]: time="2026-09-08T07:12:55.339Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T07:13:25.338" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:55.339" grpc.time_ms=0.586 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.184569] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.144Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2a4613df47ec632d9bb520cf","created_at":"2026-09-08T07:12:54.875Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.876Z","job_size_bytes":6,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2a4613df47ec632d9bb520cf: start","job_status":"start","queue_duration_s":0.268016,"scheduling_latency_s":0.268035} gitlab # [ 255.243108] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.153Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2a4613df47ec632d9bb520cf","created_at":"2026-09-08T07:12:54.875Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.876Z","job_size_bytes":6,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2a4613df47ec632d9bb520cf: done: 0.009102 sec","job_status":"done","queue_duration_s":0.268016,"scheduling_latency_s":0.268035,"redis_calls":7,"redis_duration_s":0.000892,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000227,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009102,"completed_at":"2026-09-08T07:12:55.153Z","load_balancing_strategy":"primary","db_duration_s":0.000269,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.244753] gitaly[913]: time="2026-09-08T07:12:55.359Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSNJW324HDRTSA2ER0MJN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:25.358" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:55.358" grpc.time_ms=0.442 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.284700] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/71d9770cc1955c24351c5f5ddaf2597e8921843b/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 120 gitlab # [ 255.285556] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.154Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"31db15f215fcf36b278e7db2","created_at":"2026-09-08T07:12:54.876Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.877Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-31db15f215fcf36b278e7db2: start","job_status":"start","queue_duration_s":0.276874,"scheduling_latency_s":0.276887} gitlab # [ 255.285855] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.168Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"31db15f215fcf36b278e7db2","created_at":"2026-09-08T07:12:54.876Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.877Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-31db15f215fcf36b278e7db2: done: 0.013989 sec","job_status":"done","queue_duration_s":0.276874,"scheduling_latency_s":0.276887,"redis_calls":7,"redis_duration_s":0.000928,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013989,"completed_at":"2026-09-08T07:12:55.168Z","load_balancing_strategy":"primary","db_duration_s":0.002604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.306365] gitaly[913]: time="2026-09-08T07:12:55.450Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSPKVHP18F1N66B9CW8PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T07:13:25.047" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T07:12:55.449" grpc.time_ms=0.802 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.352549] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.168Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"c19444d7d9201fcb117abf0b","created_at":"2026-09-08T07:12:54.952Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.953Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c19444d7d9201fcb117abf0b: start","job_status":"start","queue_duration_s":0.215851,"scheduling_latency_s":0.215864} gitlab # [ 255.353210] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.367Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"c19444d7d9201fcb117abf0b","created_at":"2026-09-08T07:12:54.952Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-de4217df70464ac7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:54.953Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c19444d7d9201fcb117abf0b: done: 0.198493 sec","job_status":"done","queue_duration_s":0.215851,"scheduling_latency_s":0.215864,"gitaly_calls":3,"gitaly_duration_s":0.071011,"redis_calls":65,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.006782,"redis_read_bytes":144,"redis_write_bytes":16875,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000307,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000774,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":20,"redis_queues_duration_s":0.001511,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11224,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.002414,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000146,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000319,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.04,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074682,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.178584429,"duration_s":0.198493,"completed_at":"2026-09-08T07:12:55.367Z","load_balancing_strategy":"primary","db_duration_s":0.05043,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 255.404658] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:55 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 69 gitlab # [ 255.405412] gitaly[913]: time="2026-09-08T07:12:55.671Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSPSJQ3QB8CQPW93ATRT9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:55.665" grpc.time_ms=5.493 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 255.406072] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.369Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"606a78c0b48d15f01b7166d4","created_at":"2026-09-08T07:12:55.204Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.205Z","job_size_bytes":23,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-606a78c0b48d15f01b7166d4: start","job_status":"start","queue_duration_s":0.163451,"scheduling_latency_s":0.163466} gitlab # [ 255.406621] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.402Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"606a78c0b48d15f01b7166d4","created_at":"2026-09-08T07:12:55.204Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.205Z","job_size_bytes":23,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-606a78c0b48d15f01b7166d4: done: 0.033097 sec","job_status":"done","queue_duration_s":0.163451,"scheduling_latency_s":0.163466,"redis_calls":7,"redis_duration_s":0.001597,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000605,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033097,"completed_at":"2026-09-08T07:12:55.402Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006923,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 255.441089] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.403Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"acda57a6bdc0a2b2df776d1d","created_at":"2026-09-08T07:12:55.278Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.280Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-acda57a6bdc0a2b2df776d1d: start","job_status":"start","queue_duration_s":0.122953,"scheduling_latency_s":0.122973} gitlab # [ 255.491075] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.420Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"acda57a6bdc0a2b2df776d1d","created_at":"2026-09-08T07:12:55.278Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.280Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-acda57a6bdc0a2b2df776d1d: done: 0.016909 sec","job_status":"done","queue_duration_s":0.122953,"scheduling_latency_s":0.122973,"redis_calls":7,"redis_duration_s":0.000938,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016909,"completed_at":"2026-09-08T07:12:55.420Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002991,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.492121] gitlab-workhorse[827]: time="2026-09-08T07:12:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 255.492782] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 90 gitlab # [ 255.494545] gitaly[913]: time="2026-09-08T07:12:55.762Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSPVRY5V09PEM4H8HDJKR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:55.754" pid=913 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 255.503673] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.421Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"af518a73ee77cf1895b7b528","created_at":"2026-09-08T07:12:55.285Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.286Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-af518a73ee77cf1895b7b528: start","job_status":"start","queue_duration_s":0.135005,"scheduling_latency_s":0.135019} gitlab # [ 255.544264] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.437Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"af518a73ee77cf1895b7b528","created_at":"2026-09-08T07:12:55.285Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.286Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-af518a73ee77cf1895b7b528: done: 0.016095 sec","job_status":"done","queue_duration_s":0.135005,"scheduling_latency_s":0.135019,"redis_calls":7,"redis_duration_s":0.001216,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016095,"completed_at":"2026-09-08T07:12:55.437Z","load_balancing_strategy":"primary","db_duration_s":0.002542,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.587280] gitaly[913]: time="2026-09-08T07:12:55.762Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSPVRY5V09PEM4H8HDJKR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:55.754" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 255.587887] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:55 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 107 gitlab # [ 255.588466] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.438Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"c73abde3b051126b8f93f8ab","created_at":"2026-09-08T07:12:55.290Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.291Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-c73abde3b051126b8f93f8ab: start","job_status":"start","queue_duration_s":0.146561,"scheduling_latency_s":0.146576} gitlab # [ 255.590698] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.457Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"c73abde3b051126b8f93f8ab","created_at":"2026-09-08T07:12:55.290Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.291Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-c73abde3b051126b8f93f8ab: done: 0.019297 sec","job_status":"done","queue_duration_s":0.146561,"scheduling_latency_s":0.146576,"redis_calls":10,"redis_duration_s":0.0014650000000000002,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000675,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000402,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000388,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019297,"completed_at":"2026-09-08T07:12:55.457Z","load_balancing_strategy":"primary","db_duration_s":0.004001,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.653518] gitaly[913]: time="2026-09-08T07:12:55.762Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSPVRY5V09PEM4H8HDJKR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:55.754" grpc.time_ms=7.98 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 255.654167] gitlab-workhorse[827]: time="2026-09-08T07:12:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 255.654550] gitlab-workhorse[827]: gitlab 2001:db8:1::1 - - [2026/09/08:07:12:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 61 gitlab # [ 255.655789] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.458Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8ee55e9f541d05e5f0b91054","created_at":"2026-09-08T07:12:55.291Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.292Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8ee55e9f541d05e5f0b91054: start","job_status":"start","queue_duration_s":0.165624,"scheduling_latency_s":0.165638} gitlab # [ 255.656496] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.473Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8ee55e9f541d05e5f0b91054","created_at":"2026-09-08T07:12:55.291Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.292Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8ee55e9f541d05e5f0b91054: done: 0.015039 sec","job_status":"done","queue_duration_s":0.165624,"scheduling_latency_s":0.165638,"redis_calls":7,"redis_duration_s":0.000947,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015039,"completed_at":"2026-09-08T07:12:55.473Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.701711] gitaly[913]: time="2026-09-08T07:12:55.895Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZXSPZCE4JAJV4HWWX7VVR7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:55.888" grpc.time_ms=6.965 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 255.702492] gitaly[913]: time="2026-09-08T07:12:55.957Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSQ2SN66WEC0CJXK4R1JK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:55.950" pid=913 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc gitlab # [ 255.706827] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.474Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7b02259359f7d11d02c18129","created_at":"2026-09-08T07:12:55.293Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.294Z","job_size_bytes":19,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7b02259359f7d11d02c18129: start","job_status":"start","queue_duration_s":0.179886,"scheduling_latency_s":0.179901} gitlab # [ 255.720628] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.491Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7b02259359f7d11d02c18129","created_at":"2026-09-08T07:12:55.293Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.294Z","job_size_bytes":19,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7b02259359f7d11d02c18129: done: 0.01703 sec","job_status":"done","queue_duration_s":0.179886,"scheduling_latency_s":0.179901,"redis_calls":8,"redis_duration_s":0.001604,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001067,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000537,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01703,"completed_at":"2026-09-08T07:12:55.491Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002445,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.775710] gitaly[913]: time="2026-09-08T07:12:55.958Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSQ2SN66WEC0CJXK4R1JK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:55.950" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 255.776609] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.492Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8d6b5ac8b0b848321a4676dc","created_at":"2026-09-08T07:12:55.295Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.295Z","job_size_bytes":66,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8d6b5ac8b0b848321a4676dc: start","job_status":"start","queue_duration_s":0.19672,"scheduling_latency_s":0.196744} gitlab # [ 255.783996] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.513Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8d6b5ac8b0b848321a4676dc","created_at":"2026-09-08T07:12:55.295Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.295Z","job_size_bytes":66,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8d6b5ac8b0b848321a4676dc: done: 0.020775 sec","job_status":"done","queue_duration_s":0.19672,"scheduling_latency_s":0.196744,"redis_calls":7,"redis_duration_s":0.001972,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020775,"completed_at":"2026-09-08T07:12:55.513Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006334,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.838579] gitaly[913]: time="2026-09-08T07:12:55.958Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZXSQ2SN66WEC0CJXK4R1JK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T07:12:55.950" grpc.time_ms=7.698 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=913 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 255.839513] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.516Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"ef6b44d603a2a6c4959d9e34","created_at":"2026-09-08T07:12:55.296Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.297Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ef6b44d603a2a6c4959d9e34: start","job_status":"start","queue_duration_s":0.21908,"scheduling_latency_s":0.219093} gitlab # [ 255.881748] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.622Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"ef6b44d603a2a6c4959d9e34","created_at":"2026-09-08T07:12:55.296Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.297Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ef6b44d603a2a6c4959d9e34: done: 0.106023 sec","job_status":"done","queue_duration_s":0.21908,"scheduling_latency_s":0.219093,"redis_calls":7,"redis_duration_s":0.006975,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002133,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.106023,"completed_at":"2026-09-08T07:12:55.622Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007639,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.886551] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.626Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"47bff3b0046c1c9e664c04d9","created_at":"2026-09-08T07:12:55.297Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.298Z","job_size_bytes":6,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-47bff3b0046c1c9e664c04d9: start","job_status":"start","queue_duration_s":0.327984,"scheduling_latency_s":0.328002} gitlab # [ 255.900445] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.638Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"47bff3b0046c1c9e664c04d9","created_at":"2026-09-08T07:12:55.297Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.298Z","job_size_bytes":6,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-47bff3b0046c1c9e664c04d9: done: 0.012336 sec","job_status":"done","queue_duration_s":0.327984,"scheduling_latency_s":0.328002,"redis_calls":7,"redis_duration_s":0.002565,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001879,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000686,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012336,"completed_at":"2026-09-08T07:12:55.638Z","load_balancing_strategy":"primary","db_duration_s":0.001255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.942740] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.642Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"4b43e8be1db74c7895da157c","created_at":"2026-09-08T07:12:55.298Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.299Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-4b43e8be1db74c7895da157c: start","job_status":"start","queue_duration_s":0.342854,"scheduling_latency_s":0.342869} gitlab # [ 255.983691] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.664Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"4b43e8be1db74c7895da157c","created_at":"2026-09-08T07:12:55.298Z","trace_propagation_headers":{"sentry-trace":"65864bdd2fb3411fb0ff0a546e7eadca-9caef88d1a9244a7","baggage":"sentry-trace_id=65864bdd2fb3411fb0ff0a546e7eadca,sentry-release=Unknown"},"correlation_id":"01M1ZXSNJW324HDRTSA2ER0MJN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.299Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-4b43e8be1db74c7895da157c: done: 0.022351 sec","job_status":"done","queue_duration_s":0.342854,"scheduling_latency_s":0.342869,"redis_calls":7,"redis_duration_s":0.005019,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004595,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000424,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022351,"completed_at":"2026-09-08T07:12:55.664Z","load_balancing_strategy":"primary","db_duration_s":0.00317,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.987699] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:55.975Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b115684616b7657c13035887","created_at":"2026-09-08T07:12:55.897Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7f23cd3587edd0b5f0c7e16c43ec620","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.905Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b115684616b7657c13035887: start","job_status":"start","queue_duration_s":0.069668,"scheduling_latency_s":0.069702} gitlab # [ 255.999548] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.021Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b115684616b7657c13035887","created_at":"2026-09-08T07:12:55.897Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7f23cd3587edd0b5f0c7e16c43ec620","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.905Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b115684616b7657c13035887: done: 0.046479 sec","job_status":"done","queue_duration_s":0.069668,"scheduling_latency_s":0.069702,"redis_calls":11,"redis_duration_s":0.013886,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002067,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009206,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002613,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000421562,"exclusive_lock_hold_duration_s":0.006402211,"duration_s":0.046479,"completed_at":"2026-09-08T07:12:56.021Z","load_balancing_strategy":"primary","db_duration_s":0.005133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.040146] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.023Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"2193f4a1dc39055830189250","created_at":"2026-09-08T07:12:55.977Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adf30f4709e443bb2f78a9dc8c409eb8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.989Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-2193f4a1dc39055830189250: start","job_status":"start","queue_duration_s":0.034057,"scheduling_latency_s":0.034072} gitlab # [ 256.078831] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.039Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 256.079673] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.065Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"2193f4a1dc39055830189250","created_at":"2026-09-08T07:12:55.977Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adf30f4709e443bb2f78a9dc8c409eb8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:55.989Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-2193f4a1dc39055830189250: done: 0.041776 sec","job_status":"done","queue_duration_s":0.034057,"scheduling_latency_s":0.034072,"redis_calls":9,"redis_duration_s":0.007493,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003509,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003717,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041776,"completed_at":"2026-09-08T07:12:56.065Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002267,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.088217] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.067Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a7bc345d0c2fd96a1cefa576","created_at":"2026-09-08T07:12:55.999Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c96271b3d65898233a78dca7685821cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.020Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a7bc345d0c2fd96a1cefa576: start","job_status":"start","queue_duration_s":0.046309,"scheduling_latency_s":0.046326} gitlab # [ 256.130730] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.102Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a7bc345d0c2fd96a1cefa576","created_at":"2026-09-08T07:12:55.999Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c96271b3d65898233a78dca7685821cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.020Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a7bc345d0c2fd96a1cefa576: done: 0.034976 sec","job_status":"done","queue_duration_s":0.046309,"scheduling_latency_s":0.046326,"redis_calls":11,"redis_duration_s":0.004507000000000001,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001531,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001809,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034976,"completed_at":"2026-09-08T07:12:56.102Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.136260] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"129520d5044c5e9572fe1bc0","created_at":"2026-09-08T07:12:56.028Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1091d139c1901d9733de9ae1fdee37a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.037Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-129520d5044c5e9572fe1bc0: start","job_status":"start","queue_duration_s":0.068245,"scheduling_latency_s":0.06826} gitlab # [ 256.179092] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"129520d5044c5e9572fe1bc0","created_at":"2026-09-08T07:12:56.028Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1091d139c1901d9733de9ae1fdee37a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.037Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-129520d5044c5e9572fe1bc0: done: 0.022716 sec","job_status":"done","queue_duration_s":0.068245,"scheduling_latency_s":0.06826,"redis_calls":9,"redis_duration_s":0.007036,"redis_read_bytes":7,"redis_write_bytes":1192,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003485,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000411,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022716,"completed_at":"2026-09-08T07:12:56.127Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000673,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.185742] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.130Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"74c0f23c530e5e9b26c9da7b","created_at":"2026-09-08T07:12:56.053Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea2b00f2bb5ca4b8f91354642667ee82","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.066Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-74c0f23c530e5e9b26c9da7b: start","job_status":"start","queue_duration_s":0.063973,"scheduling_latency_s":0.064008} gitlab # [ 256.233911] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.154Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 256.234608] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"74c0f23c530e5e9b26c9da7b","created_at":"2026-09-08T07:12:56.053Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea2b00f2bb5ca4b8f91354642667ee82","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.066Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-74c0f23c530e5e9b26c9da7b: done: 0.042793 sec","job_status":"done","queue_duration_s":0.063973,"scheduling_latency_s":0.064008,"redis_calls":9,"redis_duration_s":0.005201,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000815,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002372,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042793,"completed_at":"2026-09-08T07:12:56.172Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.237922] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.175Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"249aea5b4bf1c6c7e7b2cdfa","created_at":"2026-09-08T07:12:56.075Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e00db39c7bd4094472fffafa89c18783","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.082Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-249aea5b4bf1c6c7e7b2cdfa: start","job_status":"start","queue_duration_s":0.093704,"scheduling_latency_s":0.093722} gitlab # [ 256.277682] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"249aea5b4bf1c6c7e7b2cdfa","created_at":"2026-09-08T07:12:56.075Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e00db39c7bd4094472fffafa89c18783","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.082Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-249aea5b4bf1c6c7e7b2cdfa: done: 0.027234 sec","job_status":"done","queue_duration_s":0.093704,"scheduling_latency_s":0.093722,"redis_calls":11,"redis_duration_s":0.0078060000000000004,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001977,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004295,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001534,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000510121,"exclusive_lock_hold_duration_s":0.002391086,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.027234,"completed_at":"2026-09-08T07:12:56.202Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002307,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.316102] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.205Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"dd8aee3734e9f4cb7bb92281","created_at":"2026-09-08T07:12:56.088Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf4cce0ff148868f5f46019bdacf6997","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.096Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-dd8aee3734e9f4cb7bb92281: start","job_status":"start","queue_duration_s":0.108914,"scheduling_latency_s":0.108928} gitlab # [ 256.316758] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.254Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"dd8aee3734e9f4cb7bb92281","created_at":"2026-09-08T07:12:56.088Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf4cce0ff148868f5f46019bdacf6997","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.096Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-dd8aee3734e9f4cb7bb92281: done: 0.048999 sec","job_status":"done","queue_duration_s":0.108914,"scheduling_latency_s":0.108928,"redis_calls":12,"redis_duration_s":0.011962,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001532,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001259,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000488051,"exclusive_lock_hold_duration_s":0.011648967,"duration_s":0.048999,"completed_at":"2026-09-08T07:12:56.254Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.362050] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.256Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"47f89bf838acc9f4c7ddbe51","created_at":"2026-09-08T07:12:56.101Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01b5c3c0ee8f780b242b0f0f726667fd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.110Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-47f89bf838acc9f4c7ddbe51: start","job_status":"start","queue_duration_s":0.145739,"scheduling_latency_s":0.145753} gitlab # [ 256.362650] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.272Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 256.363212] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.280Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"47f89bf838acc9f4c7ddbe51","created_at":"2026-09-08T07:12:56.101Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01b5c3c0ee8f780b242b0f0f726667fd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.110Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-47f89bf838acc9f4c7ddbe51: done: 0.023747 sec","job_status":"done","queue_duration_s":0.145739,"scheduling_latency_s":0.145753,"redis_calls":9,"redis_duration_s":0.005099,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000856,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003492,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000751,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023747,"completed_at":"2026-09-08T07:12:56.280Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004395,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.391176] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.290Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"4800fd7b783593b7aa193b5b","created_at":"2026-09-08T07:12:56.119Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f47f19bb9a2807628ef82fd33ba0ba85","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.127Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-4800fd7b783593b7aa193b5b: start","job_status":"start","queue_duration_s":0.162768,"scheduling_latency_s":0.162786} gitlab # [ 256.404652] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.387Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"4800fd7b783593b7aa193b5b","created_at":"2026-09-08T07:12:56.119Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f47f19bb9a2807628ef82fd33ba0ba85","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.127Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-4800fd7b783593b7aa193b5b: done: 0.097391 sec","job_status":"done","queue_duration_s":0.162768,"scheduling_latency_s":0.162786,"redis_calls":13,"redis_duration_s":0.006118,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00255,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001445,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002123,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.037,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000461791,"exclusive_lock_hold_duration_s":0.069703273,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.097391,"completed_at":"2026-09-08T07:12:56.387Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.463869] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.388Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"943245b5cf949f464fc3374e","created_at":"2026-09-08T07:12:56.133Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae689e566716ad22665a88449610932c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T07:12:56.139Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-943245b5cf949f464fc3374e: start","job_status":"start","queue_duration_s":0.249267,"scheduling_latency_s":0.249283} gitlab # [ 256.464576] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.395Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 256.465107] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.400Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"943245b5cf949f464fc3374e","created_at":"2026-09-08T07:12:56.133Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae689e566716ad22665a88449610932c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T07:12:56.139Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-943245b5cf949f464fc3374e: done: 0.011848 sec","job_status":"done","queue_duration_s":0.249267,"scheduling_latency_s":0.249283,"redis_calls":9,"redis_duration_s":0.001141,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011848,"completed_at":"2026-09-08T07:12:56.400Z","load_balancing_strategy":"primary","db_duration_s":0.00039,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.495582] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.401Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e69416325332c5d7e3afc86f","created_at":"2026-09-08T07:12:56.150Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb6744e089214ef158e80e1d5d3a7ca1","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.158Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e69416325332c5d7e3afc86f: start","job_status":"start","queue_duration_s":0.242752,"scheduling_latency_s":0.242766} gitlab # [ 256.538064] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.423Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e69416325332c5d7e3afc86f","created_at":"2026-09-08T07:12:56.150Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb6744e089214ef158e80e1d5d3a7ca1","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.158Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e69416325332c5d7e3afc86f: done: 0.022794 sec","job_status":"done","queue_duration_s":0.242752,"scheduling_latency_s":0.242766,"redis_calls":9,"redis_duration_s":0.001431,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000461,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022794,"completed_at":"2026-09-08T07:12:56.423Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.543689] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.425Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d6a496fa3d68bde073d87eb4","created_at":"2026-09-08T07:12:56.173Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ced74762f9977a6ad2377d5b61fa3e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.178Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d6a496fa3d68bde073d87eb4: start","job_status":"start","queue_duration_s":0.246447,"scheduling_latency_s":0.246466} gitlab # [ 256.591310] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.446Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d6a496fa3d68bde073d87eb4","created_at":"2026-09-08T07:12:56.173Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ced74762f9977a6ad2377d5b61fa3e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.178Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d6a496fa3d68bde073d87eb4: done: 0.021628 sec","job_status":"done","queue_duration_s":0.246447,"scheduling_latency_s":0.246466,"redis_calls":18,"redis_duration_s":0.002191,"redis_read_bytes":20,"redis_write_bytes":4702,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000467,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000165,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000375,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021628,"completed_at":"2026-09-08T07:12:56.446Z","load_balancing_strategy":"primary","db_duration_s":0.001319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.592540] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.447Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7f450493481e00233220d88e","created_at":"2026-09-08T07:12:56.185Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a527cc700f52e340d03e4e1d08352f44","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.191Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7f450493481e00233220d88e: start","job_status":"start","queue_duration_s":0.256148,"scheduling_latency_s":0.256162} gitlab # [ 256.633591] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.566Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7f450493481e00233220d88e","created_at":"2026-09-08T07:12:56.185Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a527cc700f52e340d03e4e1d08352f44","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.191Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7f450493481e00233220d88e: done: 0.118608 sec","job_status":"done","queue_duration_s":0.256148,"scheduling_latency_s":0.256162,"redis_calls":13,"redis_duration_s":0.002015,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00045,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000299479,"exclusive_lock_hold_duration_s":0.104176927,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.118608,"completed_at":"2026-09-08T07:12:56.566Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027819,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.643722] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.567Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"db3b3c1b91d07db07e71c605","created_at":"2026-09-08T07:12:56.197Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6191763e99d649e33af585a843b8d0c2","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.204Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-db3b3c1b91d07db07e71c605: start","job_status":"start","queue_duration_s":0.362721,"scheduling_latency_s":0.362734} gitlab # [ 256.686590] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.782Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"db3b3c1b91d07db07e71c605","created_at":"2026-09-08T07:12:56.197Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6191763e99d649e33af585a843b8d0c2","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.204Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-db3b3c1b91d07db07e71c605: done: 0.215626 sec","job_status":"done","queue_duration_s":0.362721,"scheduling_latency_s":0.362734,"redis_calls":564,"redis_duration_s":0.059661,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.058677,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.180789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.215626,"completed_at":"2026-09-08T07:12:56.782Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000299,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.727327] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.783Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"de11b44a582f1aa3f0a0fd40","created_at":"2026-09-08T07:12:56.212Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a198df7fdbd1ec82d2157782bf42f58b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T07:12:56.221Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-de11b44a582f1aa3f0a0fd40: start","job_status":"start","queue_duration_s":0.562931,"scheduling_latency_s":0.562953} gitlab # [ 256.728109] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.804Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"de11b44a582f1aa3f0a0fd40","created_at":"2026-09-08T07:12:56.212Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a198df7fdbd1ec82d2157782bf42f58b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T07:12:56.221Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-de11b44a582f1aa3f0a0fd40: done: 0.020202 sec","job_status":"done","queue_duration_s":0.562931,"scheduling_latency_s":0.562953,"redis_calls":9,"redis_duration_s":0.001194,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020202,"completed_at":"2026-09-08T07:12:56.804Z","load_balancing_strategy":"primary","db_duration_s":0.002656,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.739080] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.805Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f2108a0a031acfb8e7e1cecb","created_at":"2026-09-08T07:12:56.226Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f96dfc996b2ea1bbb87717ee195ae0a7","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.233Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f2108a0a031acfb8e7e1cecb: start","job_status":"start","queue_duration_s":0.571695,"scheduling_latency_s":0.571709} gitlab # [ 256.751210] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f2108a0a031acfb8e7e1cecb","created_at":"2026-09-08T07:12:56.226Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f96dfc996b2ea1bbb87717ee195ae0a7","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.233Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f2108a0a031acfb8e7e1cecb: done: 0.018154 sec","job_status":"done","queue_duration_s":0.571695,"scheduling_latency_s":0.571709,"redis_calls":9,"redis_duration_s":0.0012360000000000001,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000721,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.018154,"completed_at":"2026-09-08T07:12:56.823Z","load_balancing_strategy":"primary","db_duration_s":0.00497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.790981] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"33852fdad585ab0b3ab32cc8","created_at":"2026-09-08T07:12:56.242Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9d382b108110d2261d2bd6b181a67bc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.247Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-33852fdad585ab0b3ab32cc8: start","job_status":"start","queue_duration_s":0.576278,"scheduling_latency_s":0.576292} gitlab # [ 256.831224] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"33852fdad585ab0b3ab32cc8","created_at":"2026-09-08T07:12:56.242Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9d382b108110d2261d2bd6b181a67bc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.247Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-33852fdad585ab0b3ab32cc8: done: 0.020978 sec","job_status":"done","queue_duration_s":0.576278,"scheduling_latency_s":0.576292,"redis_calls":11,"redis_duration_s":0.001529,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00058,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000341943,"exclusive_lock_hold_duration_s":0.006313931,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.020978,"completed_at":"2026-09-08T07:12:56.844Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005557,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.868623] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"49a3af063a0b8f727d061138","created_at":"2026-09-08T07:12:56.254Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.258Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-49a3af063a0b8f727d061138: start","job_status":"start","queue_duration_s":0.587229,"scheduling_latency_s":0.587241} gitlab # [ 256.869286] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"49a3af063a0b8f727d061138","created_at":"2026-09-08T07:12:56.254Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.258Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-49a3af063a0b8f727d061138: done: 0.070822 sec","job_status":"done","queue_duration_s":0.587229,"scheduling_latency_s":0.587241,"redis_calls":70,"redis_duration_s":0.008752,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001214,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000407,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.006778,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000353,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.070822,"completed_at":"2026-09-08T07:12:56.916Z","load_balancing_strategy":"primary","db_duration_s":0.001065,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.907554] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.917Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a02b14aaba2f7c1b21555f9a","created_at":"2026-09-08T07:12:56.264Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6cf7526d96d2d6d62370d8f12e77d590","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.268Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a02b14aaba2f7c1b21555f9a: start","job_status":"start","queue_duration_s":0.649443,"scheduling_latency_s":0.649462} gitlab # [ 256.908123] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.925Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 256.908639] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a02b14aaba2f7c1b21555f9a","created_at":"2026-09-08T07:12:56.264Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6cf7526d96d2d6d62370d8f12e77d590","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.268Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a02b14aaba2f7c1b21555f9a: done: 0.01107 sec","job_status":"done","queue_duration_s":0.649443,"scheduling_latency_s":0.649462,"redis_calls":9,"redis_duration_s":0.001102,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000243,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000618,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01107,"completed_at":"2026-09-08T07:12:56.928Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000393,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.946728] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.929Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"c9a00135d802771d4ad98ce4","created_at":"2026-09-08T07:12:56.272Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"be6064db19382f7e14cbc9519e586114","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.279Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-c9a00135d802771d4ad98ce4: start","job_status":"start","queue_duration_s":0.650456,"scheduling_latency_s":0.65047} gitlab # [ 256.949958] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.939Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"c9a00135d802771d4ad98ce4","created_at":"2026-09-08T07:12:56.272Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"be6064db19382f7e14cbc9519e586114","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.279Z","job_size_bytes":3,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-c9a00135d802771d4ad98ce4: done: 0.010063 sec","job_status":"done","queue_duration_s":0.650456,"scheduling_latency_s":0.65047,"redis_calls":10,"redis_duration_s":0.00123,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212876,"duration_s":0.010063,"completed_at":"2026-09-08T07:12:56.939Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.998053] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.940Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"dfc1ec276910a7c3f40a3402","created_at":"2026-09-08T07:12:56.289Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8ddfd338f6b40f356f17cbaa06b3b97","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.293Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-dfc1ec276910a7c3f40a3402: start","job_status":"start","queue_duration_s":0.646579,"scheduling_latency_s":0.646591} gitlab # [ 256.998709] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.950Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"dfc1ec276910a7c3f40a3402","created_at":"2026-09-08T07:12:56.289Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8ddfd338f6b40f356f17cbaa06b3b97","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.293Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-dfc1ec276910a7c3f40a3402: done: 0.010295 sec","job_status":"done","queue_duration_s":0.646579,"scheduling_latency_s":0.646591,"redis_calls":12,"redis_duration_s":0.00143,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.00028,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019332,"duration_s":0.010295,"completed_at":"2026-09-08T07:12:56.950Z","load_balancing_strategy":"primary","db_duration_s":0.000209,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.045673] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.951Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"de10114baa6f03201bc4f3b5","created_at":"2026-09-08T07:12:56.300Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd05248b7a112faebfcc72eac83f9558","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.305Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-de10114baa6f03201bc4f3b5: start","job_status":"start","queue_duration_s":0.646177,"scheduling_latency_s":0.64619} gitlab # [ 257.046589] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.965Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"de10114baa6f03201bc4f3b5","created_at":"2026-09-08T07:12:56.300Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd05248b7a112faebfcc72eac83f9558","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.305Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-de10114baa6f03201bc4f3b5: done: 0.013432 sec","job_status":"done","queue_duration_s":0.646177,"scheduling_latency_s":0.64619,"redis_calls":9,"redis_duration_s":0.001151,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000231,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013432,"completed_at":"2026-09-08T07:12:56.965Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00152,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.085693] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.965Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"7e744c866cf423f69ea78f75","created_at":"2026-09-08T07:12:56.312Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93bcac7cc1cf3d1359e49afe9de2b3de","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.324Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-7e744c866cf423f69ea78f75: start","job_status":"start","queue_duration_s":0.641694,"scheduling_latency_s":0.641708} gitlab # [ 257.092443] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.979Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"7e744c866cf423f69ea78f75","created_at":"2026-09-08T07:12:56.312Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93bcac7cc1cf3d1359e49afe9de2b3de","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.324Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-7e744c866cf423f69ea78f75: done: 0.014077 sec","job_status":"done","queue_duration_s":0.641694,"scheduling_latency_s":0.641708,"redis_calls":10,"redis_duration_s":0.001324,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198349,"duration_s":0.014077,"completed_at":"2026-09-08T07:12:56.979Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001633,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.147678] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.980Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"6dd88db3296bf569040505d4","created_at":"2026-09-08T07:12:56.329Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57ea60f324dcb391f745e2683121a594","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.333Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-6dd88db3296bf569040505d4: start","job_status":"start","queue_duration_s":0.6477,"scheduling_latency_s":0.647712} gitlab # [ 257.148619] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"6dd88db3296bf569040505d4","created_at":"2026-09-08T07:12:56.329Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57ea60f324dcb391f745e2683121a594","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.333Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-6dd88db3296bf569040505d4: done: 0.010726 sec","job_status":"done","queue_duration_s":0.6477,"scheduling_latency_s":0.647712,"redis_calls":12,"redis_duration_s":0.001423,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194158,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.010726,"completed_at":"2026-09-08T07:12:56.991Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00024,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.199485] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.992Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"6476bc5e582f258b5bddf039","created_at":"2026-09-08T07:12:56.337Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ec9550e530a514baad3e181c0e3e9a3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T07:12:56.367Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-6476bc5e582f258b5bddf039: start","job_status":"start","queue_duration_s":0.62492,"scheduling_latency_s":0.624934} gitlab # [ 257.200140] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:56.998Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 257.200639] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.002Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"6476bc5e582f258b5bddf039","created_at":"2026-09-08T07:12:56.337Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ec9550e530a514baad3e181c0e3e9a3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T07:12:56.367Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-6476bc5e582f258b5bddf039: done: 0.010176 sec","job_status":"done","queue_duration_s":0.62492,"scheduling_latency_s":0.624934,"redis_calls":9,"redis_duration_s":0.00109,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00024,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010176,"completed_at":"2026-09-08T07:12:57.002Z","load_balancing_strategy":"primary","db_duration_s":0.00022,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.239958] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.003Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"3297e8089055ee94addc15a4","created_at":"2026-09-08T07:12:56.374Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d77de00426fc26c9a07cd1b1452fcbd","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.380Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-3297e8089055ee94addc15a4: start","job_status":"start","queue_duration_s":0.622724,"scheduling_latency_s":0.622737} gitlab # [ 257.240886] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"3297e8089055ee94addc15a4","created_at":"2026-09-08T07:12:56.374Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-c54b264b2a824ee2","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d77de00426fc26c9a07cd1b1452fcbd","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.380Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-3297e8089055ee94addc15a4: done: 0.016741 sec","job_status":"done","queue_duration_s":0.622724,"scheduling_latency_s":0.622737,"redis_calls":12,"redis_duration_s":0.0015830000000000002,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000568,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005104,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.016741,"completed_at":"2026-09-08T07:12:57.020Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001656,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 257.287313] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.020Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8d91bb4ade49ceff65851d5c","created_at":"2026-09-08T07:12:56.435Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f32eaaa04a2f488a","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ced74762f9977a6ad2377d5b61fa3e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.442Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8d91bb4ade49ceff65851d5c: start","job_status":"start","queue_duration_s":0.578612,"scheduling_latency_s":0.578625} gitlab # [ 257.288407] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.029Z","message":"No existing merge request to be cleaned up."} gitlab # [ 257.289848] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.036Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8d91bb4ade49ceff65851d5c","created_at":"2026-09-08T07:12:56.435Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f32eaaa04a2f488a","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ced74762f9977a6ad2377d5b61fa3e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.442Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8d91bb4ade49ceff65851d5c: done: 0.015445 sec","job_status":"done","queue_duration_s":0.578612,"scheduling_latency_s":0.578625,"redis_calls":12,"redis_duration_s":0.001488,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000735,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015445,"completed_at":"2026-09-08T07:12:57.036Z","load_balancing_strategy":"primary","db_duration_s":0.001861,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.332968] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.037Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6fb72c2e115d7d7c8a41c2f2","created_at":"2026-09-08T07:12:56.435Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f32eaaa04a2f488a","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ced74762f9977a6ad2377d5b61fa3e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.442Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6fb72c2e115d7d7c8a41c2f2: start","job_status":"start","queue_duration_s":0.594895,"scheduling_latency_s":0.59491} gitlab # [ 257.334176] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.044Z","message":"No existing merge request to be cleaned up."} gitlab # [ 257.335550] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.051Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6fb72c2e115d7d7c8a41c2f2","created_at":"2026-09-08T07:12:56.435Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f32eaaa04a2f488a","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ced74762f9977a6ad2377d5b61fa3e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.442Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6fb72c2e115d7d7c8a41c2f2: done: 0.014179 sec","job_status":"done","queue_duration_s":0.594895,"scheduling_latency_s":0.59491,"redis_calls":10,"redis_duration_s":0.001513,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014179,"completed_at":"2026-09-08T07:12:57.051Z","load_balancing_strategy":"primary","db_duration_s":0.001283,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.369253] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.052Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1555e67a8dba311ce404fb42","created_at":"2026-09-08T07:12:56.435Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f32eaaa04a2f488a","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ced74762f9977a6ad2377d5b61fa3e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.442Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1555e67a8dba311ce404fb42: start","job_status":"start","queue_duration_s":0.610117,"scheduling_latency_s":0.610137} gitlab # [ 257.408581] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.059Z","message":"No existing merge request to be cleaned up."} gitlab # [ 257.409188] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.065Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1555e67a8dba311ce404fb42","created_at":"2026-09-08T07:12:56.435Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f32eaaa04a2f488a","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ced74762f9977a6ad2377d5b61fa3e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.442Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1555e67a8dba311ce404fb42: done: 0.013371 sec","job_status":"done","queue_duration_s":0.610117,"scheduling_latency_s":0.610137,"redis_calls":10,"redis_duration_s":0.001483,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00064,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000843,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013371,"completed_at":"2026-09-08T07:12:57.065Z","load_balancing_strategy":"primary","db_duration_s":0.00103,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.413729] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.066Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f52a0b29e67596a029995c0a","created_at":"2026-09-08T07:12:56.435Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f32eaaa04a2f488a","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ced74762f9977a6ad2377d5b61fa3e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.442Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f52a0b29e67596a029995c0a: start","job_status":"start","queue_duration_s":0.624633,"scheduling_latency_s":0.624654} gitlab # [ 257.424571] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.074Z","message":"No existing merge request to be cleaned up."} gitlab # [ 257.425957] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.079Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f52a0b29e67596a029995c0a","created_at":"2026-09-08T07:12:56.435Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f32eaaa04a2f488a","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ced74762f9977a6ad2377d5b61fa3e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.442Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f52a0b29e67596a029995c0a: done: 0.012493 sec","job_status":"done","queue_duration_s":0.624633,"scheduling_latency_s":0.624654,"redis_calls":10,"redis_duration_s":0.001268,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000734,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012493,"completed_at":"2026-09-08T07:12:57.079Z","load_balancing_strategy":"primary","db_duration_s":0.001402,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.470901] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"664ac1af9e54a57ed9f65ef6","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-664ac1af9e54a57ed9f65ef6: start","job_status":"start","queue_duration_s":0.179914,"scheduling_latency_s":0.179929} gitlab # [ 257.471675] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"664ac1af9e54a57ed9f65ef6","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-664ac1af9e54a57ed9f65ef6: done: 0.012735 sec","job_status":"done","queue_duration_s":0.179914,"scheduling_latency_s":0.179929,"redis_calls":15,"redis_duration_s":0.001701,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012735,"completed_at":"2026-09-08T07:12:57.092Z","load_balancing_strategy":"primary","db_duration_s":0.00024,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.516704] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8963817a3f8c40d2d1e19a33","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8963817a3f8c40d2d1e19a33: start","job_status":"start","queue_duration_s":0.193462,"scheduling_latency_s":0.193477} gitlab # [ 257.517464] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8963817a3f8c40d2d1e19a33","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8963817a3f8c40d2d1e19a33: done: 0.008726 sec","job_status":"done","queue_duration_s":0.193462,"scheduling_latency_s":0.193477,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008726,"completed_at":"2026-09-08T07:12:57.102Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.557725] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faf7e5206155a7c3cc718c07","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faf7e5206155a7c3cc718c07: start","job_status":"start","queue_duration_s":0.202988,"scheduling_latency_s":0.203} gitlab # [ 257.558212] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faf7e5206155a7c3cc718c07","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faf7e5206155a7c3cc718c07: done: 0.008633 sec","job_status":"done","queue_duration_s":0.202988,"scheduling_latency_s":0.203,"redis_calls":13,"redis_duration_s":0.001463,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008633,"completed_at":"2026-09-08T07:12:57.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.606112] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d752ff2675c5fd246b87f93","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d752ff2675c5fd246b87f93: start","job_status":"start","queue_duration_s":0.212395,"scheduling_latency_s":0.212418} gitlab # [ 257.606698] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d752ff2675c5fd246b87f93","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d752ff2675c5fd246b87f93: done: 0.008689 sec","job_status":"done","queue_duration_s":0.212395,"scheduling_latency_s":0.212418,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008689,"completed_at":"2026-09-08T07:12:57.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.643555] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f6ec44fc72fdfb1e494d635","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f6ec44fc72fdfb1e494d635: start","job_status":"start","queue_duration_s":0.221894,"scheduling_latency_s":0.221907} gitlab # [ 257.644948] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f6ec44fc72fdfb1e494d635","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f6ec44fc72fdfb1e494d635: done: 0.008713 sec","job_status":"done","queue_duration_s":0.221894,"scheduling_latency_s":0.221907,"redis_calls":13,"redis_duration_s":0.00143,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008713,"completed_at":"2026-09-08T07:12:57.130Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.686750] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4aaa75d5d3553d1ae14ebb26","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4aaa75d5d3553d1ae14ebb26: start","job_status":"start","queue_duration_s":0.231412,"scheduling_latency_s":0.231425} gitlab # [ 257.724368] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4aaa75d5d3553d1ae14ebb26","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4aaa75d5d3553d1ae14ebb26: done: 0.009141 sec","job_status":"done","queue_duration_s":0.231412,"scheduling_latency_s":0.231425,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009141,"completed_at":"2026-09-08T07:12:57.140Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.725464] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1df9ed70b7fcf040da2a6205","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1df9ed70b7fcf040da2a6205: start","job_status":"start","queue_duration_s":0.241349,"scheduling_latency_s":0.241363} gitlab # [ 257.732251] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1df9ed70b7fcf040da2a6205","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1df9ed70b7fcf040da2a6205: done: 0.008661 sec","job_status":"done","queue_duration_s":0.241349,"scheduling_latency_s":0.241363,"redis_calls":13,"redis_duration_s":0.001416,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008661,"completed_at":"2026-09-08T07:12:57.150Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.770042] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fed5ce64c8ad415d3f6107b3","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fed5ce64c8ad415d3f6107b3: start","job_status":"start","queue_duration_s":0.250826,"scheduling_latency_s":0.250839} gitlab # [ 257.776149] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fed5ce64c8ad415d3f6107b3","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fed5ce64c8ad415d3f6107b3: done: 0.008695 sec","job_status":"done","queue_duration_s":0.250826,"scheduling_latency_s":0.250839,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008695,"completed_at":"2026-09-08T07:12:57.159Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.815637] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d8c7e833e6755b89f80fa7a","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d8c7e833e6755b89f80fa7a: start","job_status":"start","queue_duration_s":0.26033,"scheduling_latency_s":0.260343} gitlab # [ 257.819750] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d8c7e833e6755b89f80fa7a","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d8c7e833e6755b89f80fa7a: done: 0.008914 sec","job_status":"done","queue_duration_s":0.26033,"scheduling_latency_s":0.260343,"redis_calls":13,"redis_duration_s":0.00162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001155,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008914,"completed_at":"2026-09-08T07:12:57.169Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.866645] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7410d8e6f4b6f742e3df4202","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7410d8e6f4b6f742e3df4202: start","job_status":"start","queue_duration_s":0.270048,"scheduling_latency_s":0.27006} gitlab # [ 257.867513] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7410d8e6f4b6f742e3df4202","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7410d8e6f4b6f742e3df4202: done: 0.008693 sec","job_status":"done","queue_duration_s":0.270048,"scheduling_latency_s":0.27006,"redis_calls":13,"redis_duration_s":0.0015119999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008693,"completed_at":"2026-09-08T07:12:57.179Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.913656] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97c2e398f6a4293aca6e744d","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97c2e398f6a4293aca6e744d: start","job_status":"start","queue_duration_s":0.279549,"scheduling_latency_s":0.279562} gitlab # [ 257.914077] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97c2e398f6a4293aca6e744d","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97c2e398f6a4293aca6e744d: done: 0.008674 sec","job_status":"done","queue_duration_s":0.279549,"scheduling_latency_s":0.279562,"redis_calls":13,"redis_duration_s":0.001488,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008674,"completed_at":"2026-09-08T07:12:57.188Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.973645] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f30f47ec4bd23ff4b8539215","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f30f47ec4bd23ff4b8539215: start","job_status":"start","queue_duration_s":0.28901,"scheduling_latency_s":0.289023} gitlab # [ 257.974530] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f30f47ec4bd23ff4b8539215","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f30f47ec4bd23ff4b8539215: done: 0.008601 sec","job_status":"done","queue_duration_s":0.28901,"scheduling_latency_s":0.289023,"redis_calls":13,"redis_duration_s":0.001469,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008601,"completed_at":"2026-09-08T07:12:57.197Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.984742] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a038f9522af2aa37210057a0","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a038f9522af2aa37210057a0: start","job_status":"start","queue_duration_s":0.298381,"scheduling_latency_s":0.298394} gitlab # [ 258.028661] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a038f9522af2aa37210057a0","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a038f9522af2aa37210057a0: done: 0.008669 sec","job_status":"done","queue_duration_s":0.298381,"scheduling_latency_s":0.298394,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008669,"completed_at":"2026-09-08T07:12:57.207Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.029633] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f5875959c1d244b75602b0a","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f5875959c1d244b75602b0a: start","job_status":"start","queue_duration_s":0.307858,"scheduling_latency_s":0.307871} gitlab # [ 258.067554] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f5875959c1d244b75602b0a","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f5875959c1d244b75602b0a: done: 0.012155 sec","job_status":"done","queue_duration_s":0.307858,"scheduling_latency_s":0.307871,"redis_calls":13,"redis_duration_s":0.001676,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012155,"completed_at":"2026-09-08T07:12:57.220Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.105596] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3958c802254c642abe0e7d22","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3958c802254c642abe0e7d22: start","job_status":"start","queue_duration_s":0.321045,"scheduling_latency_s":0.321059} gitlab # [ 258.106459] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3958c802254c642abe0e7d22","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3958c802254c642abe0e7d22: done: 0.009083 sec","job_status":"done","queue_duration_s":0.321045,"scheduling_latency_s":0.321059,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009083,"completed_at":"2026-09-08T07:12:57.230Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.143949] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e88fac0f5fc0805774e29d75","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e88fac0f5fc0805774e29d75: start","job_status":"start","queue_duration_s":0.330937,"scheduling_latency_s":0.33095} gitlab # [ 258.144700] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e88fac0f5fc0805774e29d75","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e88fac0f5fc0805774e29d75: done: 0.008857 sec","job_status":"done","queue_duration_s":0.330937,"scheduling_latency_s":0.33095,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008857,"completed_at":"2026-09-08T07:12:57.240Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.182332] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"def0f4de5ec37d8b676d23b7","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-def0f4de5ec37d8b676d23b7: start","job_status":"start","queue_duration_s":0.340619,"scheduling_latency_s":0.340632} gitlab # [ 258.183039] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"def0f4de5ec37d8b676d23b7","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-def0f4de5ec37d8b676d23b7: done: 0.008825 sec","job_status":"done","queue_duration_s":0.340619,"scheduling_latency_s":0.340632,"redis_calls":13,"redis_duration_s":0.0015090000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008825,"completed_at":"2026-09-08T07:12:57.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.224871] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8d42bc6819b59a0573ab2b1","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8d42bc6819b59a0573ab2b1: start","job_status":"start","queue_duration_s":0.350255,"scheduling_latency_s":0.350268} gitlab # [ 258.225657] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8d42bc6819b59a0573ab2b1","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8d42bc6819b59a0573ab2b1: done: 0.008661 sec","job_status":"done","queue_duration_s":0.350255,"scheduling_latency_s":0.350268,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008661,"completed_at":"2026-09-08T07:12:57.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.246565] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a2395c53f1ab13d612cac6e","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a2395c53f1ab13d612cac6e: start","job_status":"start","queue_duration_s":0.359726,"scheduling_latency_s":0.359739} gitlab # [ 258.288130] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a2395c53f1ab13d612cac6e","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a2395c53f1ab13d612cac6e: done: 0.009101 sec","job_status":"done","queue_duration_s":0.359726,"scheduling_latency_s":0.359739,"redis_calls":13,"redis_duration_s":0.001863,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001326,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009101,"completed_at":"2026-09-08T07:12:57.269Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.325133] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff68af7f51c482c7b5791c29","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff68af7f51c482c7b5791c29: start","job_status":"start","queue_duration_s":0.369669,"scheduling_latency_s":0.369681} gitlab # [ 258.325782] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff68af7f51c482c7b5791c29","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff68af7f51c482c7b5791c29: done: 0.008837 sec","job_status":"done","queue_duration_s":0.369669,"scheduling_latency_s":0.369681,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008837,"completed_at":"2026-09-08T07:12:57.278Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.332953] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2810ae8077f0c692e9fe0c44","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2810ae8077f0c692e9fe0c44: start","job_status":"start","queue_duration_s":0.379309,"scheduling_latency_s":0.379321} gitlab # [ 258.370441] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2810ae8077f0c692e9fe0c44","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2810ae8077f0c692e9fe0c44: done: 0.009284 sec","job_status":"done","queue_duration_s":0.379309,"scheduling_latency_s":0.379321,"redis_calls":13,"redis_duration_s":0.001996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001479,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009284,"completed_at":"2026-09-08T07:12:57.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.375986] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05acce50a56280cd5561f0e8","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05acce50a56280cd5561f0e8: start","job_status":"start","queue_duration_s":0.389388,"scheduling_latency_s":0.389409} gitlab # [ 258.386928] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05acce50a56280cd5561f0e8","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05acce50a56280cd5561f0e8: done: 0.008691 sec","job_status":"done","queue_duration_s":0.389388,"scheduling_latency_s":0.389409,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000457,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008691,"completed_at":"2026-09-08T07:12:57.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.450096] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e37c32580eaa85d946a66359","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e37c32580eaa85d946a66359: start","job_status":"start","queue_duration_s":0.398892,"scheduling_latency_s":0.398905} gitlab # [ 258.450769] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e37c32580eaa85d946a66359","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e37c32580eaa85d946a66359: done: 0.008536 sec","job_status":"done","queue_duration_s":0.398892,"scheduling_latency_s":0.398905,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008536,"completed_at":"2026-09-08T07:12:57.307Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.489551] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c60a7731524530b6dcf24bed","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c60a7731524530b6dcf24bed: start","job_status":"start","queue_duration_s":0.408226,"scheduling_latency_s":0.408239} gitlab # [ 258.490311] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c60a7731524530b6dcf24bed","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c60a7731524530b6dcf24bed: done: 0.00863 sec","job_status":"done","queue_duration_s":0.408226,"scheduling_latency_s":0.408239,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00863,"completed_at":"2026-09-08T07:12:57.317Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.527197] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf7040de79bcd7446e3d6a74","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf7040de79bcd7446e3d6a74: start","job_status":"start","queue_duration_s":0.417667,"scheduling_latency_s":0.41768} gitlab # [ 258.527956] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf7040de79bcd7446e3d6a74","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf7040de79bcd7446e3d6a74: done: 0.00871 sec","job_status":"done","queue_duration_s":0.417667,"scheduling_latency_s":0.41768,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00871,"completed_at":"2026-09-08T07:12:57.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.566049] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"267a1dd8745cb2a82742dac8","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-267a1dd8745cb2a82742dac8: start","job_status":"start","queue_duration_s":0.427201,"scheduling_latency_s":0.427215} gitlab # [ 258.566726] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"267a1dd8745cb2a82742dac8","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-267a1dd8745cb2a82742dac8: done: 0.00861 sec","job_status":"done","queue_duration_s":0.427201,"scheduling_latency_s":0.427215,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00861,"completed_at":"2026-09-08T07:12:57.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.603459] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"284221df69c3b920e3018ce6","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-284221df69c3b920e3018ce6: start","job_status":"start","queue_duration_s":0.436715,"scheduling_latency_s":0.436728} gitlab # [ 258.604059] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"284221df69c3b920e3018ce6","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-284221df69c3b920e3018ce6: done: 0.008567 sec","job_status":"done","queue_duration_s":0.436715,"scheduling_latency_s":0.436728,"redis_calls":13,"redis_duration_s":0.001415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008567,"completed_at":"2026-09-08T07:12:57.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.644717] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74fdef759ded5393a43d392f","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74fdef759ded5393a43d392f: start","job_status":"start","queue_duration_s":0.44609,"scheduling_latency_s":0.446103} gitlab # [ 258.649693] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74fdef759ded5393a43d392f","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74fdef759ded5393a43d392f: done: 0.008687 sec","job_status":"done","queue_duration_s":0.44609,"scheduling_latency_s":0.446103,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008687,"completed_at":"2026-09-08T07:12:57.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.717760] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a45e15b63300f64af65dcf9e","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a45e15b63300f64af65dcf9e: start","job_status":"start","queue_duration_s":0.455567,"scheduling_latency_s":0.45558} gitlab # [ 258.718591] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a45e15b63300f64af65dcf9e","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a45e15b63300f64af65dcf9e: done: 0.008773 sec","job_status":"done","queue_duration_s":0.455567,"scheduling_latency_s":0.45558,"redis_calls":13,"redis_duration_s":0.0016179999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001156,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008773,"completed_at":"2026-09-08T07:12:57.364Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.758802] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e26c8b8f5422b88025b34424","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e26c8b8f5422b88025b34424: start","job_status":"start","queue_duration_s":0.465125,"scheduling_latency_s":0.465138} gitlab # [ 258.759635] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e26c8b8f5422b88025b34424","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e26c8b8f5422b88025b34424: done: 0.008849 sec","job_status":"done","queue_duration_s":0.465125,"scheduling_latency_s":0.465138,"redis_calls":13,"redis_duration_s":0.001439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008849,"completed_at":"2026-09-08T07:12:57.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.809204] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea5410aa07df9ead5fcf2329","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea5410aa07df9ead5fcf2329: start","job_status":"start","queue_duration_s":0.474789,"scheduling_latency_s":0.474801} gitlab # [ 258.809988] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea5410aa07df9ead5fcf2329","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea5410aa07df9ead5fcf2329: done: 0.008679 sec","job_status":"done","queue_duration_s":0.474789,"scheduling_latency_s":0.474801,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008679,"completed_at":"2026-09-08T07:12:57.383Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.825784] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"050c21f86a3771a9c5e33da7","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-050c21f86a3771a9c5e33da7: start","job_status":"start","queue_duration_s":0.484262,"scheduling_latency_s":0.484274} gitlab # [ 258.837278] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"050c21f86a3771a9c5e33da7","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-050c21f86a3771a9c5e33da7: done: 0.008463 sec","job_status":"done","queue_duration_s":0.484262,"scheduling_latency_s":0.484274,"redis_calls":13,"redis_duration_s":0.001449,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008463,"completed_at":"2026-09-08T07:12:57.393Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.880227] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b78d3bc004ce6ed01674544","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b78d3bc004ce6ed01674544: start","job_status":"start","queue_duration_s":0.493495,"scheduling_latency_s":0.493508} gitlab # [ 258.884083] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b78d3bc004ce6ed01674544","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b78d3bc004ce6ed01674544: done: 0.008587 sec","job_status":"done","queue_duration_s":0.493495,"scheduling_latency_s":0.493508,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008587,"completed_at":"2026-09-08T07:12:57.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.937095] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d180141eeca18872457dcbb","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d180141eeca18872457dcbb: start","job_status":"start","queue_duration_s":0.502881,"scheduling_latency_s":0.502894} gitlab # [ 258.937782] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d180141eeca18872457dcbb","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d180141eeca18872457dcbb: done: 0.008611 sec","job_status":"done","queue_duration_s":0.502881,"scheduling_latency_s":0.502894,"redis_calls":13,"redis_duration_s":0.001439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008611,"completed_at":"2026-09-08T07:12:57.411Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.004556] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e621a37d45c0d1a768ec8e9","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e621a37d45c0d1a768ec8e9: start","job_status":"start","queue_duration_s":0.512369,"scheduling_latency_s":0.512382} gitlab # [ 259.005439] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e621a37d45c0d1a768ec8e9","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e621a37d45c0d1a768ec8e9: done: 0.008634 sec","job_status":"done","queue_duration_s":0.512369,"scheduling_latency_s":0.512382,"redis_calls":13,"redis_duration_s":0.0014010000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000458,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008634,"completed_at":"2026-09-08T07:12:57.421Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.012544] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ffe10dd7dd087c4786d68cb","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ffe10dd7dd087c4786d68cb: start","job_status":"start","queue_duration_s":0.521816,"scheduling_latency_s":0.521828} gitlab # [ 259.055914] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ffe10dd7dd087c4786d68cb","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ffe10dd7dd087c4786d68cb: done: 0.008534 sec","job_status":"done","queue_duration_s":0.521816,"scheduling_latency_s":0.521828,"redis_calls":13,"redis_duration_s":0.001416,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008534,"completed_at":"2026-09-08T07:12:57.430Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.058711] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02e109bb6bc046523f150c49","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02e109bb6bc046523f150c49: start","job_status":"start","queue_duration_s":0.531149,"scheduling_latency_s":0.531162} gitlab # [ 259.106639] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02e109bb6bc046523f150c49","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02e109bb6bc046523f150c49: done: 0.008558 sec","job_status":"done","queue_duration_s":0.531149,"scheduling_latency_s":0.531162,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008558,"completed_at":"2026-09-08T07:12:57.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.107610] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bba3669877bf048612068031","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bba3669877bf048612068031: start","job_status":"start","queue_duration_s":0.540486,"scheduling_latency_s":0.540499} gitlab # [ 259.151179] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bba3669877bf048612068031","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bba3669877bf048612068031: done: 0.008575 sec","job_status":"done","queue_duration_s":0.540486,"scheduling_latency_s":0.540499,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000459,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008575,"completed_at":"2026-09-08T07:12:57.449Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.152222] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3bf6550c1d240fa0367524f","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3bf6550c1d240fa0367524f: start","job_status":"start","queue_duration_s":0.549983,"scheduling_latency_s":0.549996} gitlab # [ 259.162610] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3bf6550c1d240fa0367524f","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3bf6550c1d240fa0367524f: done: 0.008889 sec","job_status":"done","queue_duration_s":0.549983,"scheduling_latency_s":0.549996,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008889,"completed_at":"2026-09-08T07:12:57.459Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.206272] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1d7386d198cc4ea784b9e33","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1d7386d198cc4ea784b9e33: start","job_status":"start","queue_duration_s":0.559736,"scheduling_latency_s":0.559749} gitlab # [ 259.209029] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1d7386d198cc4ea784b9e33","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1d7386d198cc4ea784b9e33: done: 0.008949 sec","job_status":"done","queue_duration_s":0.559736,"scheduling_latency_s":0.559749,"redis_calls":13,"redis_duration_s":0.0016380000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008949,"completed_at":"2026-09-08T07:12:57.468Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.245657] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5de23386fa88dfd994797d40","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5de23386fa88dfd994797d40: start","job_status":"start","queue_duration_s":0.569509,"scheduling_latency_s":0.569545} gitlab # [ 259.256945] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5de23386fa88dfd994797d40","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5de23386fa88dfd994797d40: done: 0.008775 sec","job_status":"done","queue_duration_s":0.569509,"scheduling_latency_s":0.569545,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008775,"completed_at":"2026-09-08T07:12:57.478Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.303691] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f71e55b985cebe001cd8bdcd","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f71e55b985cebe001cd8bdcd: start","job_status":"start","queue_duration_s":0.579145,"scheduling_latency_s":0.579159} gitlab # [ 259.304522] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f71e55b985cebe001cd8bdcd","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f71e55b985cebe001cd8bdcd: done: 0.008732 sec","job_status":"done","queue_duration_s":0.579145,"scheduling_latency_s":0.579159,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008732,"completed_at":"2026-09-08T07:12:57.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.362162] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bdf122a3a8bd836aee2e0c5","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bdf122a3a8bd836aee2e0c5: start","job_status":"start","queue_duration_s":0.588708,"scheduling_latency_s":0.588721} gitlab # [ 259.362960] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.497Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bdf122a3a8bd836aee2e0c5","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bdf122a3a8bd836aee2e0c5: done: 0.008794 sec","job_status":"done","queue_duration_s":0.588708,"scheduling_latency_s":0.588721,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008794,"completed_at":"2026-09-08T07:12:57.497Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.404347] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0572d03493ea074f1aab48fc","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0572d03493ea074f1aab48fc: start","job_status":"start","queue_duration_s":0.598294,"scheduling_latency_s":0.598308} gitlab # [ 259.405170] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0572d03493ea074f1aab48fc","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0572d03493ea074f1aab48fc: done: 0.008823 sec","job_status":"done","queue_duration_s":0.598294,"scheduling_latency_s":0.598308,"redis_calls":13,"redis_duration_s":0.001428,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000459,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008823,"completed_at":"2026-09-08T07:12:57.507Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.468210] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c28543621ec5b6fad8e808a8","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c28543621ec5b6fad8e808a8: start","job_status":"start","queue_duration_s":0.607915,"scheduling_latency_s":0.607928} gitlab # [ 259.468898] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c28543621ec5b6fad8e808a8","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c28543621ec5b6fad8e808a8: done: 0.008844 sec","job_status":"done","queue_duration_s":0.607915,"scheduling_latency_s":0.607928,"redis_calls":13,"redis_duration_s":0.0014470000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008844,"completed_at":"2026-09-08T07:12:57.517Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.479645] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e103eb793a2edfed5b55b0a4","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e103eb793a2edfed5b55b0a4: start","job_status":"start","queue_duration_s":0.617546,"scheduling_latency_s":0.617558} gitlab # [ 259.490961] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e103eb793a2edfed5b55b0a4","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e103eb793a2edfed5b55b0a4: done: 0.012342 sec","job_status":"done","queue_duration_s":0.617546,"scheduling_latency_s":0.617558,"redis_calls":13,"redis_duration_s":0.001716,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012342,"completed_at":"2026-09-08T07:12:57.530Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.538052] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36d887df77fceb7e9ee2a627","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36d887df77fceb7e9ee2a627: start","job_status":"start","queue_duration_s":0.630863,"scheduling_latency_s":0.630877} gitlab # [ 259.538792] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36d887df77fceb7e9ee2a627","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36d887df77fceb7e9ee2a627: done: 0.009999 sec","job_status":"done","queue_duration_s":0.630863,"scheduling_latency_s":0.630877,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009999,"completed_at":"2026-09-08T07:12:57.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.601713] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3716d8836b9ace74ca149b12","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3716d8836b9ace74ca149b12: start","job_status":"start","queue_duration_s":0.641711,"scheduling_latency_s":0.641726} gitlab # [ 259.602615] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3716d8836b9ace74ca149b12","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3716d8836b9ace74ca149b12: done: 0.009046 sec","job_status":"done","queue_duration_s":0.641711,"scheduling_latency_s":0.641726,"redis_calls":13,"redis_duration_s":0.0015279999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009046,"completed_at":"2026-09-08T07:12:57.551Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.620551] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c35d47582891307923319ba","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c35d47582891307923319ba: start","job_status":"start","queue_duration_s":0.65161,"scheduling_latency_s":0.651623} gitlab # [ 259.662896] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c35d47582891307923319ba","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c35d47582891307923319ba: done: 0.008759 sec","job_status":"done","queue_duration_s":0.65161,"scheduling_latency_s":0.651623,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008759,"completed_at":"2026-09-08T07:12:57.560Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.703907] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac1afdce4917b0bd0ea5cd36","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac1afdce4917b0bd0ea5cd36: start","job_status":"start","queue_duration_s":0.66122,"scheduling_latency_s":0.661233} gitlab # [ 259.704642] sidekiq-cluster[2532]: {"severity":"INFO","time":"2026-09-08T07:12:57.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac1afdce4917b0bd0ea5cd36","created_at":"2026-09-08T07:12:56.857Z","trace_propagation_headers":{"sentry-trace":"eb397814b3844bdd978770079383d9bf-f88a222507cd4b1b","baggage":"sentry-trace_id=eb397814b3844bdd978770079383d9bf,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c0cab099624f0bcc0ee758ffa085cfd0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T07:12:56.900Z","job_size_bytes":2,"pid":2532,"sidekiq_tid":"m7ws","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac1afdce4917b0bd0ea5cd36: done: 0.009007 sec","job_status":"done","queue_duration_s":0.66122,"scheduling_latency_s":0.661233,"redis_calls":13,"redis_duration_s":0.001663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009007,"completed_at":"2026-09-08T07:12:57.570Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} test script finished in 320.36s cleanup kill QemuMachine (pid 46) gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14) (finished: cleanup, in 1.36 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-08T07:12:01.541Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '71d9770cc1955c24351c5f5ddaf2597e8921843b', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-08T07:12:47.700296Z', 'started_at': '2026-09-08T07:12:48.034404Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}] [{'id': 5, 'sha': '71d9770cc1955c24351c5f5ddaf2597e8921843b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T07:12:48.011Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '71d9770cc1955c24351c5f5ddaf2597e8921843b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T07:12:48.011Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '71d9770cc1955c24351c5f5ddaf2597e8921843b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T07:12:48.011Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '71d9770cc1955c24351c5f5ddaf2597e8921843b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T07:12:48.011Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '71d9770cc1955c24351c5f5ddaf2597e8921843b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T07:12:48.011Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '71d9770cc1955c24351c5f5ddaf2597e8921843b', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 6s (1 warning)', 'created_at': '2026-09-08T07:12:48.011Z', 'started_at': None, 'finished_at': '2026-09-08T07:12:54.594Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '71d9770cc1955c24351c5f5ddaf2597e8921843b', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-09-08T07:12:54.791Z', 'started_at': None, 'finished_at': '2026-09-08T07:12:54.908Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]