tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.w6LiJaJ1lj', fmt=raw size=1073741824 (finished: start all VMs, in 48.85 seconds) gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab: waiting for unit setup-gitlab.service gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for the VM to finish booting gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab # Filesystem UUID: 125a6d05-dda6-45bb-be39-a8c2e7775caf gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)... gitlab # gitlab # gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)... gitlab # gitlab # gitlab # Booting from ROM... gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/alpknypj5b4cq1fajm6w8kgi783ypf1c-nixos-system-gitlab-test/init regInfo=/nix/store/zfdzcydpya8b811q1mpckhdx25fgf5ph-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.000000] BIOS-provided physical RAM map: gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved gitlab # [ 0.000000] NX (Execute Disable) protection: active gitlab # [ 0.000000] APIC: Static calls initialized gitlab # [ 0.000000] SMBIOS 2.8 present. gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 gitlab # [ 0.000000] DMI: Memory slots populated: 1/1 gitlab # [ 0.000000] Hypervisor detected: KVM gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 gitlab # [ 0.000000] kvm-clock: using sched offset of 465972554 cycles gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor gitlab # [ 0.000809] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000 gitlab # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs gitlab # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT gitlab # [ 0.000876] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.002730] found SMP MP-table at [mem 0x000f5470-0x000f547f] gitlab # [ 0.002741] Using GB pages for direct mapping gitlab # [ 0.002836] RAMDISK: [mem 0xbe31c000-0xbffcffff] gitlab # [ 0.002844] ACPI: Early table checksum verification disabled gitlab # [ 0.002847] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) gitlab # [ 0.002850] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002854] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002861] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002863] ACPI: FACS 0x00000000BFFE0000 000040 gitlab # [ 0.002864] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002866] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002867] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002869] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2] gitlab # [ 0.002870] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e] gitlab # [ 0.002870] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] gitlab # [ 0.002871] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482] gitlab # [ 0.002871] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba] gitlab # [ 0.002872] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2] gitlab # [ 0.003100] No NUMA configuration found gitlab # [ 0.003101] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff] gitlab # [ 0.003104] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff] gitlab # [ 0.005442] Zone ranges: gitlab # [ 0.005444] DMA [mem 0x0000000000001000-0x0000000000ffffff] gitlab # [ 0.005445] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] gitlab # [ 0.005446] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005447] Device empty gitlab # [ 0.005448] Movable zone start for each node gitlab # [ 0.005449] Early memory node ranges gitlab # [ 0.005449] node 0: [mem 0x0000000000001000-0x000000000009efff] gitlab # [ 0.005450] node 0: [mem 0x0000000000100000-0x00000000bffd7fff] gitlab # [ 0.005451] node 0: [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005452] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff] gitlab # [ 0.005473] On node 0, zone DMA: 1 pages in unavailable ranges gitlab # [ 0.005748] On node 0, zone DMA: 97 pages in unavailable ranges gitlab # [ 0.116192] On node 0, zone Normal: 40 pages in unavailable ranges gitlab # [ 0.116617] ACPI: PM-Timer IO Port: 0x608 gitlab # [ 0.116632] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) gitlab # [ 0.116669] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 gitlab # [ 0.116671] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) gitlab # [ 0.116673] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) gitlab # [ 0.116674] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) gitlab # [ 0.116676] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) gitlab # [ 0.116676] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) gitlab # [ 0.116679] ACPI: Using ACPI (MADT) for SMP configuration information gitlab # [ 0.116680] ACPI: HPET id: 0x8086a201 base: 0xfed00000 gitlab # [ 0.116684] TSC deadline timer available gitlab # [ 0.116688] CPU topo: Max. logical packages: 1 gitlab # [ 0.116689] CPU topo: Max. logical dies: 1 gitlab # [ 0.116690] CPU topo: Max. dies per package: 1 gitlab # [ 0.116693] CPU topo: Max. threads per core: 1 gitlab # [ 0.116694] CPU topo: Num. cores per package: 4 gitlab # [ 0.116694] CPU topo: Num. threads per package: 4 gitlab # [ 0.116695] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs gitlab # [ 0.116718] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() gitlab # [ 0.116735] kvm-guest: KVM setup pv remote TLB flush gitlab # [ 0.116737] kvm-guest: setup PV sched yield gitlab # [ 0.116753] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] gitlab # [ 0.116754] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] gitlab # [ 0.116755] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff] gitlab # [ 0.116757] [mem 0xc0000000-0xfeffbfff] available for PCI devices gitlab # [ 0.116758] Booting paravirtualized kernel on KVM gitlab # [ 0.116762] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns gitlab # [ 0.121218] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 gitlab # [ 0.123481] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 gitlab # [ 0.123530] kvm-guest: PV spinlocks enabled gitlab # [ 0.123532] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) gitlab # [ 0.123535] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/alpknypj5b4cq1fajm6w8kgi783ypf1c-nixos-system-gitlab-test/init regInfo=/nix/store/zfdzcydpya8b811q1mpckhdx25fgf5ph-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.123630] Unknown kernel command line parameters "regInfo=/nix/store/zfdzcydpya8b811q1mpckhdx25fgf5ph-closure-info/registration", will be passed to user space. gitlab # [ 0.123648] random: crng init done gitlab # [ 0.123649] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes gitlab # [ 0.132708] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.137387] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.137463] software IO TLB: area num 4. gitlab # [ 0.213086] Fallback order for Node 0: 0 gitlab # [ 0.213094] Built 1 zonelists, mobility grouping on. Total pages: 1572726 gitlab # [ 0.213096] Policy zone: Normal gitlab # [ 0.215650] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.225586] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.239327] allocated 12582912 bytes of page_ext gitlab # [ 0.249391] ftrace: allocating 48717 entries in 192 pages gitlab # [ 0.249393] ftrace: allocated 192 pages with 2 groups gitlab # [ 0.250260] Dynamic Preempt: lazy gitlab # [ 0.250428] rcu: Preemptible hierarchical RCU implementation. gitlab # [ 0.250429] rcu: RCU event tracing is enabled. gitlab # [ 0.250430] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.250431] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.250432] Rude variant of Tasks RCU enabled. gitlab # [ 0.250432] Tracing variant of Tasks RCU enabled. gitlab # [ 0.250433] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. gitlab # [ 0.250434] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.250460] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.250462] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.250463] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.254832] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 gitlab # [ 0.255158] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.255166] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns gitlab # [ 0.255283] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.258811] Console: colour VGA+ 80x25 gitlab # [ 0.258814] printk: legacy console [tty0] enabled gitlab # [ 0.290027] printk: legacy console [ttyS0] enabled gitlab # [ 0.387617] ACPI: Core revision 20250807 gitlab # [ 0.388476] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns gitlab # [ 0.390026] APIC: Switch to symmetric I/O mode setup gitlab # [ 0.390996] x2apic enabled gitlab # [ 0.391774] APIC: Switched APIC routing to: physical x2apic gitlab # [ 0.392647] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() gitlab # [ 0.393818] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() gitlab # [ 0.395289] kvm-guest: setup PV IPIs gitlab # [ 0.396837] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 gitlab # [ 0.397857] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 0.399586] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008) gitlab # [ 0.401657] x86/cpu: User Mode Instruction Prevention (UMIP) activated gitlab # [ 0.402699] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 gitlab # [ 0.404330] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 gitlab # [ 0.405401] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto gitlab # [ 0.406583] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl gitlab # [ 0.408583] Transient Scheduler Attacks: Vulnerable: No microcode gitlab # [ 0.409583] Spectre V2 : Mitigation: Enhanced / Automatic IBRS gitlab # [ 0.410583] Speculative Return Stack Overflow: Mitigation: Safe RET gitlab # [ 0.411583] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization gitlab # [ 0.412590] Spectre V2 : Enabling IBPB for BPF gitlab # [ 0.413584] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier gitlab # [ 0.414584] active return thunk: srso_alias_return_thunk gitlab # [ 0.416285] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' gitlab # [ 0.417583] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' gitlab # [ 0.418583] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' gitlab # [ 0.419583] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' gitlab # [ 0.420583] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' gitlab # [ 0.421583] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' gitlab # [ 0.422583] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' gitlab # [ 0.423584] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 gitlab # [ 0.425366] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 gitlab # [ 0.426360] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 gitlab # [ 0.427364] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 gitlab # [ 0.428355] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 gitlab # [ 0.429357] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. gitlab # [ 0.459504] Freeing SMP alternatives memory: 44K gitlab # [ 0.460171] pid_max: default: 32768 minimum: 301 gitlab # [ 0.460707] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.461691] landlock: Up and running. gitlab # [ 0.463058] Yama: becoming mindful. gitlab # [ 0.463794] LSM support for eBPF active gitlab # [ 0.464815] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.465746] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.468984] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) gitlab # [ 0.470524] Performance Events: Fam17h+ core perfctr, AMD PMU driver. gitlab # [ 0.471410] ... version: 2 gitlab # [ 0.472120] ... bit width: 48 gitlab # [ 0.472600] ... generic counters: 6 gitlab # [ 0.473367] ... generic bitmap: 000000000000003f gitlab # [ 0.473586] ... fixed-purpose counters: 0 gitlab # [ 0.474318] ... fixed-purpose bitmap: 0000000000000000 gitlab # [ 0.474585] ... value mask: 0000ffffffffffff gitlab # [ 0.475498] ... max period: 00007fffffffffff gitlab # [ 0.476305] ... global_ctrl mask: 000000000000003f gitlab # [ 0.476703] signal: max sigframe size: 3376 gitlab # [ 0.477503] rcu: Hierarchical SRCU implementation. gitlab # [ 0.478224] rcu: Max phase no-delay instances is 400. gitlab # [ 0.478772] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.484163] smp: Bringing up secondary CPUs ... gitlab # [ 0.484998] smpboot: x86: Booting SMP configuration: gitlab # [ 0.485594] .... node #0, CPUs: #1 #2 #3 gitlab # [ 0.488684] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.490322] smpboot: Total of 4 processors activated (19200.06 BogoMIPS) gitlab # [ 0.491177] Memory: 6011364K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved) gitlab # [ 0.493587] devtmpfs: initialized gitlab # [ 0.494453] x86/mm: Memory block size: 128MB gitlab # [ 0.497665] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.498665] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.499683] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.500887] PM: RTC time: 08:15:58, date: 2026-08-20 gitlab # [ 0.504629] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.506908] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.507640] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.509715] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.510597] audit: initializing netlink subsys (disabled) gitlab # [ 0.511605] audit: type=2000 audit(1787213759.059:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.511860] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.513586] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.514586] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.515585] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.516585] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.517599] cpuidle: using governor menu gitlab # [ 0.519782] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 gitlab # [ 0.520824] PCI: Using configuration type 1 for base access gitlab # [ 0.521587] PCI: Using configuration type 1 for extended access gitlab # [ 0.522771] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. gitlab # [ 0.525626] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.526587] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.527586] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.528585] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.533231] ACPI: Added _OSI(Module Device) gitlab # [ 0.535594] ACPI: Added _OSI(Processor Device) gitlab # [ 0.536593] ACPI: Added _OSI(Processor Aggregator Device) gitlab # [ 0.544663] ACPI: 1 ACPI AML tables successfully acquired and loaded gitlab # [ 0.554831] ACPI: Interpreter enabled gitlab # [ 0.555534] ACPI: PM: (supports S0 S3 S4 S5) gitlab # [ 0.556125] ACPI: Using IOAPIC for interrupt routing gitlab # [ 0.556841] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug gitlab # [ 0.559596] PCI: Using E820 reservations for host bridge windows gitlab # [ 0.563206] ACPI: Enabled 2 GPEs in block 00 to 0F gitlab # [ 0.576286] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) gitlab # [ 0.578601] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] gitlab # [ 0.583740] acpiphp: Slot [3] registered gitlab # [ 0.585645] acpiphp: Slot [4] registered gitlab # [ 0.586652] acpiphp: Slot [5] registered gitlab # [ 0.588663] acpiphp: Slot [6] registered gitlab # [ 0.590657] acpiphp: Slot [7] registered gitlab # [ 0.591639] acpiphp: Slot [8] registered gitlab # [ 0.593640] acpiphp: Slot [9] registered gitlab # [ 0.594646] acpiphp: Slot [10] registered gitlab # [ 0.596631] acpiphp: Slot [11] registered gitlab # [ 0.597629] acpiphp: Slot [12] registered gitlab # [ 0.598645] acpiphp: Slot [13] registered gitlab # [ 0.600630] acpiphp: Slot [14] registered gitlab # [ 0.601627] acpiphp: Slot [15] registered gitlab # [ 0.602628] acpiphp: Slot [16] registered gitlab # [ 0.604644] acpiphp: Slot [17] registered gitlab # [ 0.605628] acpiphp: Slot [18] registered gitlab # [ 0.607628] acpiphp: Slot [19] registered gitlab # [ 0.608628] acpiphp: Slot [20] registered gitlab # [ 0.609649] acpiphp: Slot [21] registered gitlab # [ 0.611630] acpiphp: Slot [22] registered gitlab # [ 0.612579] acpiphp: Slot [23] registered gitlab # [ 0.613121] acpiphp: Slot [24] registered gitlab # [ 0.613615] acpiphp: Slot [25] registered gitlab # [ 0.614334] acpiphp: Slot [26] registered gitlab # [ 0.614607] acpiphp: Slot [27] registered gitlab # [ 0.615333] acpiphp: Slot [28] registered gitlab # [ 0.616606] acpiphp: Slot [29] registered gitlab # [ 0.617335] acpiphp: Slot [30] registered gitlab # [ 0.617605] acpiphp: Slot [31] registered gitlab # [ 0.618387] PCI host bridge to bus 0000:00 gitlab # [ 0.619595] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] gitlab # [ 0.620603] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] gitlab # [ 0.621588] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] gitlab # [ 0.623586] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.624586] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.627629] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.630310] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.635230] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint gitlab # [ 0.639693] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint gitlab # [ 0.645661] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f] gitlab # [ 0.647659] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk gitlab # [ 0.650591] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk gitlab # [ 0.652590] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk gitlab # [ 0.655593] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk gitlab # [ 0.657953] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint gitlab # [ 0.663660] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f] gitlab # [ 0.667602] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint gitlab # [ 0.670120] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI gitlab # [ 0.672602] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB gitlab # [ 0.675014] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint gitlab # [ 0.691645] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] gitlab # [ 0.692631] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] gitlab # [ 0.693624] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref] gitlab # [ 0.694903] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] gitlab # [ 0.698487] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.709629] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] gitlab # [ 0.712607] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] gitlab # [ 0.714645] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] gitlab # [ 0.741606] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] gitlab # [ 0.746569] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.751622] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f] gitlab # [ 0.752517] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] gitlab # [ 0.753366] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] gitlab # [ 0.756834] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.762655] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf] gitlab # [ 0.764608] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] gitlab # [ 0.767645] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] gitlab # [ 0.774207] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.782624] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df] gitlab # [ 0.784602] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] gitlab # [ 0.786633] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] gitlab # [ 0.791194] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.801620] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] gitlab # [ 0.803603] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] gitlab # [ 0.804633] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] gitlab # [ 0.810106] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.814623] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff] gitlab # [ 0.815544] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] gitlab # [ 0.817381] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] gitlab # [ 0.822885] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.833628] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff] gitlab # [ 0.835608] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] gitlab # [ 0.838646] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] gitlab # [ 0.841607] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref] gitlab # [ 0.846657] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.853622] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] gitlab # [ 0.855654] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] gitlab # [ 0.861982] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.870641] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f] gitlab # [ 0.873607] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] gitlab # [ 0.875645] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] gitlab # [ 0.881099] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.891620] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f] gitlab # [ 0.893603] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff] gitlab # [ 0.895632] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] gitlab # [ 0.905523] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 gitlab # [ 0.907912] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 gitlab # [ 0.910865] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 gitlab # [ 0.912845] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 gitlab # [ 0.914737] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 gitlab # [ 0.919614] iommu: Default domain type: Translated gitlab # [ 0.920590] iommu: DMA domain TLB invalidation policy: lazy mode gitlab # [ 0.922980] ACPI: bus type USB registered gitlab # [ 0.924680] usbcore: registered new interface driver usbfs gitlab # [ 0.926614] usbcore: registered new interface driver hub gitlab # [ 0.928610] usbcore: registered new device driver usb gitlab # [ 0.932059] NetLabel: Initializing gitlab # [ 0.933587] NetLabel: domain hash size = 128 gitlab # [ 0.934364] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO gitlab # [ 0.935634] NetLabel: unlabeled traffic allowed by default gitlab # [ 0.936595] PCI: Using ACPI for IRQ routing gitlab # [ 0.937737] pci 0000:00:02.0: vgaarb: setting as boot VGA device gitlab # [ 0.938582] pci 0000:00:02.0: vgaarb: bridge control possible gitlab # [ 0.938582] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none gitlab # [ 0.940589] vgaarb: loaded gitlab # [ 0.941311] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 gitlab # [ 0.942587] hpet0: 3 comparators, 64-bit 100.000000 MHz counter gitlab # [ 0.946983] clocksource: Switched to clocksource kvm-clock gitlab # [ 0.951606] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.953310] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.956591] pnp: PnP ACPI init gitlab # [ 0.959356] pnp: PnP ACPI: found 6 devices gitlab # [ 0.971490] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns gitlab # [ 0.974275] clocksource: Switched to clocksource acpi_pm gitlab # [ 0.976876] NET: Registered PF_INET protocol family gitlab # [ 0.981797] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 1.019282] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 1.020793] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 1.022197] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 1.024845] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 1.026197] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 1.027828] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 1.029448] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 1.030897] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 1.032265] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 1.033316] NET: Registered PF_XDP protocol family gitlab # [ 1.034186] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] gitlab # [ 1.035211] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] gitlab # [ 1.036219] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] gitlab # [ 1.037361] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] gitlab # [ 1.038526] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 1.039878] pci 0000:00:01.0: PIIX3: Enabling Passive Release gitlab # [ 1.040894] pci 0000:00:00.0: Limiting direct PCI/PCI transfers gitlab # [ 1.043354] ACPI: \_SB_.LNKD: Enabled at IRQ 11 gitlab # [ 1.045929] PCI: CLS 0 bytes, default 64 gitlab # [ 1.046756] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) gitlab # [ 1.047146] Trying to unpack rootfs image as initramfs... gitlab # [ 1.047852] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB) gitlab # [ 1.047978] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 1.071143] Initialise system trusted keyrings gitlab # [ 1.072410] workingset: timestamp_bits=40 max_order=21 bucket_order=0 gitlab # [ 1.083865] Key type asymmetric registered gitlab # [ 1.084617] Asymmetric key parser 'x509' registered gitlab # [ 1.085564] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) gitlab # [ 1.087166] io scheduler mq-deadline registered gitlab # [ 1.087964] io scheduler kyber registered gitlab # [ 1.091946] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 1.093274] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A gitlab # [ 1.095638] Linux agpgart interface v0.103 gitlab # [ 1.096456] ACPI: bus type drm_connector registered gitlab # [ 1.099097] usbcore: registered new interface driver usbserial_generic gitlab # [ 1.100196] usbserial: USB Serial support registered for generic gitlab # [ 1.101204] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. gitlab # [ 1.101204] Please enable it if your BIOS has the CPPC option. gitlab # [ 1.103537] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled gitlab # [ 1.104925] drop_monitor: Initializing network drop monitor service gitlab # [ 1.106139] NET: Registered PF_INET6 protocol family gitlab # [ 1.107858] Segment Routing with IPv6 gitlab # [ 1.108571] In-situ OAM (IOAM) with IPv6 gitlab # [ 1.110902] IPI shorthand broadcast: enabled gitlab # [ 1.115344] sched_clock: Marking stable (978011033, 136416819)->(1133132222, -18704370) gitlab # [ 1.117088] registered taskstats version 1 gitlab # [ 1.118120] Loading compiled-in X.509 certificates gitlab # [ 1.127684] Demotion targets for Node 0: null gitlab # [ 1.128700] Key type .fscrypt registered gitlab # [ 1.129443] Key type fscrypt-provisioning registered gitlab # [ 1.130395] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 1.131351] ima: Allocated hash algorithm: sha1 gitlab # [ 1.132159] ima: No architecture policies found gitlab # [ 1.133154] PM: Magic number: 6:83:271 gitlab # [ 1.134752] RAS: Correctable Errors collector initialized. gitlab # [ 1.139210] clk: Disabling unused clocks gitlab # [ 1.139918] PM: genpd: Disabling unused power domains gitlab # [ 1.337089] Freeing initrd memory: 29392K gitlab # [ 1.340677] Freeing unused decrypted memory: 2028K gitlab # [ 1.343401] Freeing unused kernel image (initmem) memory: 3640K gitlab # [ 1.344534] Write protecting the kernel read-only data: 32768k gitlab # [ 1.346631] Freeing unused kernel image (text/rodata gap) memory: 1220K gitlab # [ 1.350357] Freeing unused kernel image (rodata/data gap) memory: 760K gitlab # [ 1.401824] x86/mm: Checked W+X mappings: passed, no W+X pages found. gitlab # [ 1.402955] Run /init as init process gitlab # [ 1.414767] systemd[1]: Inserted module 'autofs4' gitlab # [ 1.436084] fuse: init (API version 7.45) gitlab # [ 1.444759] ACPI: \_SB_.LNKC: Enabled at IRQ 10 gitlab # [ 1.452351] ACPI: \_SB_.LNKA: Enabled at IRQ 10 gitlab # [ 1.455657] ACPI: \_SB_.LNKB: Enabled at IRQ 11 gitlab # [ 1.494314] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.830994] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.871798] systemd[1]: Detected virtualization kvm. gitlab # [ 1.873962] systemd[1]: Detected architecture x86-64. gitlab # [ 1.876047] systemd[1]: Running in initrd. gitlab # [ 1.878499] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.881314] systemd[1]: Hostname set to . gitlab # [ 1.990774] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 2.030996] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 2.046077] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 2.047290] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 2.048823] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 2.050002] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 2.051124] systemd[1]: Reached target Path Units. gitlab # [ 2.052007] systemd[1]: Reached target Slice Units. gitlab # [ 2.052940] systemd[1]: Reached target Swaps. gitlab # [ 2.053778] systemd[1]: Reached target Timer Units. gitlab # [ 2.054787] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 2.056019] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 2.057240] systemd[1]: Listening on Journal Sockets. gitlab # [ 2.058223] systemd[1]: Listening on udev Control Socket. gitlab # [ 2.059232] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 2.060170] systemd[1]: Reached target Socket Units. gitlab # [ 2.062039] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 2.064632] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 2.066632] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 2.074636] systemd[1]: Starting Journal Service... gitlab # [ 2.081328] systemd[1]: Starting Load Kernel Modules... gitlab # [ 2.082292] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 2.087015] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 2.090630] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 2.092278] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 2.096789] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 2.098391] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config gitlab # [ 2.107851] systemd-journald[92]: Collecting audit messages is disabled. gitlab # [ 2.109084] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 2.131808] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 2.131956] netfs: FS-Cache loaded gitlab # [ 2.137189] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 2.139500] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 2.142530] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 2.142705] 9pnet: Installing 9P2000 support gitlab # [ 2.144512] systemd[1]: Finished Load Kernel Modules. gitlab # [ 2.150765] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 2.017382] systemd-modules-l[ 2.153811] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # oad[93]: Using 4 probe threads gitlab # [ 2.019369] systemd-modules-load[93]: Inserted module 'virtio_balloon' gitlab # [ 2.156345] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 2.020346] systemd-modules-load[93]: Inserted module 'virtio_gpu' gitlab # [ 2.021786] systemd-modules-load[93]: Inserted module 'dm_mod' gitlab # [ 2.159651] systemd[1]: Started Journal Service. gitlab # [ 2.024918] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 2.028864] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 2.030328] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 2.031253] systemd[1]: Reached target Local File Systems. gitlab # [ 2.031986] systemd[1]: Starting Create System Files and Directories... gitlab # [ 2.032816] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 2.053075] systemd[1]: Finished Create System Files and Directories. gitlab # [ 2.060431] systemd-udevd[112]: Using default interface naming scheme 'v261'. gitlab # [ 2.070533] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 2.093037] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.093803] systemd[1]: Reached target System Initialization. gitlab # [ 2.094597] systemd[1]: Reached target Basic System. gitlab # [ 2.295278] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 2.297998] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 2.303621] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 2.313137] virtio_blk virtio5: [vdb] 11789168 512-byte logical blocks (6.04 GB/5.62 GiB) gitlab # [ 2.319102] SCSI subsystem initialized gitlab # [ 2.333681] uhci_hcd 0000:00:01.2: UHCI Host Controller gitlab # [ 2.334535] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 gitlab # [ 2.335726] uhci_hcd 0000:00:01.2: detected 2 ports gitlab # [ 2.344775] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140 gitlab # [ 2.346051] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 gitlab # [ 2.347187] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 gitlab # [ 2.348177] usb usb1: Product: UHCI Host Controller gitlab # [ 2.348836] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd gitlab # [ 2.349599] usb usb1: SerialNumber: 0000:00:01.2 gitlab # [ 2.350583] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 gitlab # [ 2.351558] hub 1-0:1.0: USB hub found gitlab # [ 2.352761] serio: i8042 KBD port at 0x60,0x64 irq 1 gitlab # [ 2.353339] hub 1-0:1.0: 2 ports detected gitlab # [ 2.353693] serio: i8042 AUX port at 0x60,0x64 irq 12 gitlab # [ 2.362220] scsi host0: ata_piix gitlab # [ 2.363964] scsi host1: ata_piix gitlab # [ 2.364701] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0 gitlab # [ 2.365847] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0 gitlab # [ 2.242392] (udev-worker)[116]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.245125] (udev-worker)[134]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.247425] (udev-worker)[134]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.252770] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.263851] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.266978] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.267898] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.268652] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.278885] systemd-vconsole-setup[150]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.281295] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.290068] systemd-fsck[155]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.293123] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.527898] ata2: found unknown device (class 0) gitlab # [ 2.530608] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 gitlab # [ 2.534675] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 gitlab # [ 2.564310] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 gitlab # [ 2.576456] usb 1-1: new full-speed USB device number 2 using uhci_hcd gitlab # [ 2.594710] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray gitlab # [ 2.622033] cdrom: Uniform CD-ROM driver Revision: 3.20 gitlab # [ 2.742561] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 gitlab # [ 2.743852] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 gitlab # [ 2.744935] usb 1-1: Product: QEMU USB Tablet gitlab # [ 2.745601] usb 1-1: Manufacturer: QEMU gitlab # [ 2.746176] usb 1-1: SerialNumber: 28754-0000:00:01.2-1 gitlab # [ 2.778143] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 2.790819] usbcore: registered new interface driver usbhid gitlab # [ 2.792832] usbhid: USB HID core driver gitlab # [ 2.802142] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 gitlab # [ 2.806480] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 gitlab # [ 2.957121] systemd[1]: Mounting /sysroot... gitlab # [ 3.242296] EXT4-fs (vda): mounted filesystem 125a6d05-dda6-45bb-be39-a8c2e7775caf r/w with ordered data mode. Quota mode: none. gitlab # [ 3.111428] systemd[1]: Mounted /sysroot. gitlab # [ 3.112325] systemd[1]: Reached target Initrd Root File System. gitlab # [ 3.113620] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.114457] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.116157] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.118161] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.120252] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.128096] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.140942] systemd-sysroot-fstab-check[177]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.142466] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 3.143283] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.280465] 9p: Installing v9fs 9p2000 file system support gitlab # [ 3.148983] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.151554] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.152765] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.154173] systemd[1]: Reload requested from client PID 177 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.155956] systemd[1]: Reloading... gitlab # [ 3.296849] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 3.221211] systemd[1]: Reloading finished in 64 ms. gitlab # [ 3.248782] systemd-sysroot-fstab-check[177]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.250718] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.252099] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.253600] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.257823] systemd-sysroot-fstab-check[177]: Requesting swap.target/start/replace... gitlab # [ 3.260318] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.261833] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.263400] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.264703] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.285744] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.287241] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.957367] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 4.001053] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 4.002597] systemd[1]: Reached target Initrd File Systems. gitlab # [ 4.004478] systemd[1]: Starting Find NixOS closure... gitlab # [ 4.006456] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 4.022892] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 4.025198] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 4.043174] systemd[1]: Finished Find NixOS closure. gitlab # [ 4.044495] systemd[1]: Reached target Initrd Default Target. gitlab # [ 4.046549] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 4.076364] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 4.077676] systemd[1]: Stopped target Basic System. gitlab # [ 4.078795] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 4.079950] systemd[1]: Stopped target Path Units. gitlab # [ 4.081085] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 4.082479] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 4.083947] systemd[1]: Stopped target Slice Units. gitlab # [ 4.085098] systemd[1]: Stopped target Socket Units. gitlab # [ 4.086229] systemd[1]: Stopped target System Initialization. gitlab # [ 4.087469] systemd[1]: Stopped target Swaps. gitlab # [ 4.088617] systemd[1]: Stopped target Timer Units. gitlab # [ 4.089753] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 4.091102] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 4.092326] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 4.093750] systemd[1]: Stopped Find NixOS closure. gitlab # [ 4.094837] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 4.096703] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 4.097964] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 4.099351] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 4.100462] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 4.101969] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 4.103440] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 4.104881] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 4.106362] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 4.108497] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 4.109859] systemd[1]: Stopped target Local File Systems. gitlab # [ 4.112497] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 4.113820] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 4.115417] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 4.116479] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 4.117756] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 4.119118] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 4.120142] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 4.121347] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 4.122512] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 4.123732] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.127616] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 4.128802] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 4.130102] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 4.131363] systemd[1]: Closed udev Control Socket. gitlab # [ 4.132324] systemd[1]: Starting Cleanup udev Database... gitlab # [ 4.133322] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 4.134633] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 4.135721] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 4.137108] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 4.138309] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 4.139485] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.169733] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.170993] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.172252] systemd[1]: Reached target Switch Root. gitlab # [ 4.174338] systemd[1]: Starting NixOS Activation... gitlab # [ 4.309859] initrd-nixos-activation-start[227]: booting system configuration /nix/store/alpknypj5b4cq1fajm6w8kgi783ypf1c-nixos-system-gitlab-test gitlab # [ 4.345935] initrd-nixos-activation-start[227]: running activation script... gitlab # [ 4.559927] initrd-nixos-activation-start[250]: setting up /etc... gitlab # [ 4.649135] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.651862] systemd[1]: Finished NixOS Activation. gitlab # [ 4.653660] systemd[1]: Starting Switch Root... gitlab # [ 4.692897] systemd[1]: Switching root. gitlab # [ 4.885739] systemd-journald[92]: Received SIGTERM from PID 1 (systemd). gitlab # [ 4.998460] NET: Registered PF_VSOCK protocol family gitlab # [ 5.362567] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.371403] systemd[1]: Detected virtualization kvm. gitlab # [ 5.373219] systemd[1]: Detected architecture x86-64. gitlab # [ 5.375145] systemd[1]: Detected first boot. gitlab # [ 5.377825] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.517833] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.588554] systemd[1]: Applying preset policy. gitlab # [ 5.715870] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 5.831734] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 5.833092] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 5.835207] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 5.837443] systemd[1]: Created slice Slice /system/getty. gitlab # [ 5.838740] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 5.840197] systemd[1]: Created slice User and Session Slice. gitlab # [ 5.841096] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 5.842241] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 5.843280] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 5.844109] systemd[1]: Expecting device /dev/ttyS0... gitlab # [ 5.844869] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 5.845700] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 5.846470] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 5.847263] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 5.848169] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 5.849079] systemd[1]: Reached target Path Units. gitlab # [ 5.849777] systemd[1]: Reached target Remote File Systems. gitlab # [ 5.850581] systemd[1]: Reached target Slice Units. gitlab # [ 5.851262] systemd[1]: Reached target Swaps. gitlab # [ 5.852689] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 5.854654] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 5.856000] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 5.857565] systemd[1]: Listening on Factory Reset Management. gitlab # [ 5.858494] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 5.860698] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 5.862115] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 5.864017] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 5.865179] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 5.866313] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.867648] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 5.870397] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 5.871552] systemd[1]: Listening on udev Control Socket. gitlab # [ 5.872366] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 5.875255] systemd[1]: Mounting Huge Pages File System... gitlab # [ 5.877432] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 5.879780] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 5.888327] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 5.892751] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 5.896689] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 5.903394] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 5.904701] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 5.906518] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 5.908508] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 5.926249] systemd[1]: Mounting FUSE Control File System... gitlab # [ 5.927293] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 5.931326] systemd[1]: Starting Journal Service... gitlab # [ 5.933245] systemd[1]: Starting Load Kernel Modules... gitlab # [ 5.937528] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 5.941557] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 5.942754] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.946621] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 5.950366] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 5.951680] systemd[1]: Mounted Huge Pages File System. gitlab # [ 5.952941] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 5.954251] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 5.955390] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 5.958809] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 5.960367] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 5.962144] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 5.963451] systemd[1]: Mounted FUSE Control File System. gitlab # [ 5.967140] loop: module loaded gitlab # [ 5.968557] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 5.972037] systemd-journald[320]: Collecting audit messages is enabled. gitlab # [ 5.978190] EXT4-fs (vda): re-mounted 125a6d05-dda6-45bb-be39-a8c2e7775caf. gitlab # [ 5.981565] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 5.986100] systemd[1]: Finished Load Kernel Modules. gitlab # [ 5.988093] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 5.989321] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 5.990559] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 5.856649] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 5.857750] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 5.858792] systemd[1]: systemd-journald.service: Deactivated[ 5.995502] systemd[1]: Starting Firewall... gitlab # successfully. gitlab # [ 5.860619] systemd-modules-l[ 5.996627] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # oad[321]: Using 3 probe threads gitlab # [ 5.863152] systemd-modules-load[321]: Inserted module 'tls' gitlab # [ 5.864261] systemd-modules-load[321]: Inserted module 'loop' gitlab # [ 6.007352] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.010076] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 6.010898] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.013463] systemd[1]: Started Journal Service. gitlab # [ 5.877979] systemd-oomd[322]: No swap; memory pressure usage will be degraded gitlab # [ 5.879625] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 5.883070] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 5.892953] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 5.896159] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 5.899150] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 5.903365] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 5.908589] systemd[1]: Reached target First Boot Complete. gitlab # [ 5.913060] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 6.050378] systemd-journald[320]: Received client request to flush runtime journal. gitlab # [ 5.954470] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 5.956422] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 5.957697] systemd-udevd[359]: Using default interface naming scheme 'v261'. gitlab # [ 5.958682] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 5.975996] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 5.978260] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 6.041586] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.062355] (udev-worker)[437]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.067656] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 6.073842] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. gitlab # [ 6.076321] (udev-worker)[439]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 6.078203] (udev-worker)[439]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.091523] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 6.092679] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.094640] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.097202] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.098782] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.100607] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.101742] systemd[1]: Finished Firewall. gitlab # [ 6.255164] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 gitlab # [ 6.269289] mousedev: PS/2 mouse device common for all mice gitlab # [ 6.276484] ACPI: button: Power Button [PWRF] gitlab # [ 6.279135] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console gitlab # [ 6.288533] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 gitlab # [ 6.288589] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD gitlab # [ 6.291067] Console: switching to colour dummy device 80x25 gitlab # [ 6.293164] [drm] Found bochs VGA, ID 0xb0c5. gitlab # [ 6.293166] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. gitlab # [ 6.297982] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic gitlab # [ 6.298380] rtc_cmos 00:05: RTC can wake from S4 gitlab # [ 6.298726] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0 gitlab # [ 6.300980] parport_pc 00:03: reported by Plug and Play ACPI gitlab # [ 6.301606] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] gitlab # [ 6.308264] Floppy drive(s): fd0 is 2.88M AMI BIOS gitlab # [ 6.310599] Console: switching to colour frame buffer device 160x50 gitlab # [ 6.312975] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device gitlab # [ 6.318860] FDC 0 is a S82078B gitlab # [ 6.327954] rtc_cmos 00:05: registered as rtc0 gitlab # [ 6.328887] rtc_cmos 00:05: setting system clock to 2026-08-20T08:16:04 UTC (1787213764) gitlab # [ 6.333494] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs gitlab # [ 6.340025] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4 gitlab # [ 6.342977] systemd-journald[320]: Time jumped backwards, rotating. gitlab # [ 6.346995] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 gitlab # [ 6.361986] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 gitlab # [ 6.242093] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.395577] erofs (device vdb): failed to read inode meta block (nid: 49634429): -4 gitlab # [ 6.260499] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.262084] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.267440] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.286470] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.288144] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.301300] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.457730] ppdev: user-space parallel port driver gitlab # [ 6.479828] kvm_amd: TSC scaling supported gitlab # [ 6.480365] kvm_amd: Nested Virtualization enabled gitlab # [ 6.481088] kvm_amd: Nested Paging enabled gitlab # [ 6.481704] kvm_amd: LBR virtualization supported gitlab # [ 6.482224] kvm_amd: Virtual VMLOAD VMSAVE supported gitlab # [ 6.482985] kvm_amd: Virtual GIF supported gitlab # [ 6.483569] kvm_amd: Virtual NMI enabled gitlab # [ 6.516812] EDAC MC: Ver: 3.0.0 gitlab # [ 6.386329] systemd-vconsole-setup[495]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 6.387872] systemd[1]: Finished Virtual Console Setup. gitlab # [ 6.700505] systemd[1]: Mounting /run/wrappers... gitlab # [ 6.725955] systemd[1]: Mounted /run/wrappers. gitlab # [ 6.727539] systemd[1]: Reached target Local File Systems. gitlab # [ 6.729412] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 6.731947] systemd[1]: Starting register-nix-paths.service... gitlab # [ 6.734332] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 6.735876] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 6.738212] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 6.749256] systemd[1]: Starting Create System Files and Directories... gitlab # [ 6.770293] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 6.775992] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 6.786410] systemd[1]: Finished Create System Files and Directories. gitlab # [ 6.789567] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 6.792344] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 6.806294] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 6.821683] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 6.824790] systemd[1]: Starting Update is Completed... gitlab # [ 6.845289] systemd[1]: Finished Update is Completed. gitlab # [ 6.889176] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 6.891346] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.117595] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.119777] systemd[1]: Reached target System Initialization. gitlab # [ 7.121694] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.124074] systemd[1]: Started logrotate.timer. gitlab # [ 7.125678] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.127747] systemd[1]: Reached target Timer Units. gitlab # [ 7.129446] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.131484] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.141109] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.143060] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.145777] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.147723] systemd[1]: Reached target Socket Units. gitlab # [ 7.149500] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.181651] dbus-broker-launch[578]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.184813] dbus-broker-launch[578]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.187368] dbus-broker-launch[578]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.192170] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.207770] dbus-broker-launch[578]: Ready gitlab # [ 7.210067] systemd[1]: Reached target Basic System. gitlab # [ 7.212868] systemd[1]: Started backdoor.service. gitlab # [ 7.216666] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.220327] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.222891] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.228978] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.236432] systemd[1]: Starting Post-Boot Actions... gitlab # [ 7.244598] systemd[1]: Started Reset console on configuration changes. gitlab # connecting to host... gitlab # [ 7.248993] systemd[1]: Starting resolvconf update... gitlab # [ 7.258516] logrotate[583]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 7.259741] logrotate[583]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf gitlab # [ 7.260591] logrotate[583]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 7.261328] logrotate[583]: Reading state from file: /var/lib/logrotate.status gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.262028] logrotate[583]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.262870] logrotate[583]: Allocating hash table for state file, size 64 entries gitlab: connected to guest root shell gitlab # [ 7.263784] logrotate[583]: Handling 4 logs gitlab: (connecting took 7.88 seconds) gitlab # [ 7.264347] logrotate[583]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab: (finished: waiting for the VM to finish booting, in 7.88 seconds) gitlab # [ 7.264929] logrotate[583]: considering log /var/log/btmp gitlab # [ 7.265754] logrotate[583]: Creating new state gitlab # [ 7.266900] logrotate[583]: Now: 2026-08-20 08:16 gitlab # [ 7.269765] logrotate[583]: Last rotated at 2026-08-20 08:00 gitlab # [ 7.269998] logrotate[583]: log does not need rotating (log has already been rotated) gitlab # [ 7.270545] logrotate[583]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.271638] logrotate[583]: considering log /var/log/wtmp gitlab # [ 7.272707] logrotate[583]: Creating new state gitlab # [ 7.273537] logrotate[583]: Now: 2026-08-20 08:16 gitlab # [ 7.273976] logrotate[583]: Last rotated at 2026-08-20 08:00 gitlab # [ 7.274515] logrotate[583]: log does not need rotating (log has already been rotated) gitlab # [ 7.274921] logrotate[583]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.275487] logrotate[583]: switching euid from 0 to 165 and egid from 0 to 165 (pid 583) gitlab # [ 7.275899] logrotate[583]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.276477] logrotate[583]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.276890] logrotate[583]: Creating new state gitlab # [ 7.277771] logrotate[583]: switching euid from 165 to 0 and egid from 165 to 0 (pid 583) gitlab # [ 7.277954] logrotate[583]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.278505] logrotate[583]: switching euid from 0 to 60 and egid from 0 to 60 (pid 583) gitlab # [ 7.279052] logrotate[583]: considering log /var/log/nginx/*.log gitlab # [ 7.279390] logrotate[583]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.279861] logrotate[583]: Creating new state gitlab # [ 7.280547] logrotate[583]: not running postrotate script, since no logs were rotated gitlab # [ 7.280987] logrotate[583]: switching euid from 60 to 0 and egid from 60 to 0 (pid 583) gitlab # [ 7.281721] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.285309] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.286070] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 7.311708] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.312693] nsncd[584]: Aug 20 08:16:05.619 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.313201] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.313633] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.316718] systemd[1]: Starting User Login Management... gitlab # [ 7.339365] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 7.340069] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 7.340486] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 7.340900] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 7.342469] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 7.345615] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 7.346510] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 7.347366] systemd[1]: nscd.service: Consumed 58ms CPU time over 117ms wall clock time, 7.3M memory peak, 5.5M read from disk. gitlab # [ 7.350465] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.357127] systemd-logind[638]: New seat seat0. gitlab # [ 7.362515] systemd-logind[638]: Watching system buttons on /dev/input/event2 (Power Button) gitlab # [ 7.363714] systemd-logind[638]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 7.364880] systemd-logind[638]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) gitlab # [ 7.366116] systemd[1]: Started User Login Management. gitlab # [ 7.368965] systemd[1]: Starting linger-users.service... gitlab # [ 7.369881] nsncd[675]: Aug 20 08:16:05.676 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.370974] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.372716] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.373507] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.378810] systemd[1]: Finished resolvconf update. gitlab # [ 7.381788] systemd[1]: Reached target Preparation for Network. gitlab # [ 7.382844] systemd[1]: Starting DHCP Client... gitlab # [ 7.384780] systemd[1]: Starting Address configuration of eth1... gitlab # [ 7.386682] systemd[1]: Starting Extra networking commands.... gitlab # [ 7.388234] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 7.390374] systemd[1]: Finished linger-users.service. gitlab # [ 7.407556] network-addresses-eth1-start[700]: adding address 192.168.1.1/24... done gitlab # [ 7.411173] network-addresses-eth1-start[700]: adding address 2001:db8:1::1/64... done gitlab # [ 7.416651] systemd[1]: Finished Address configuration of eth1. gitlab # [ 7.454928] dhcpcd[714]: dhcpcd-10.3.2 starting gitlab # [ 7.455723] systemd[1]: Finished Extra networking commands.. gitlab # [ 7.456649] dhcpcd[765]: dev: loaded udev gitlab # [ 7.457401] systemd[1]: Reached target Network. gitlab # [ 7.459821] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 7.598089] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 7.598812] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 7.463659] systemd[1]: Starting Nginx Web Server... gitlab # [ 7.467597] systemd[1]: Starting PostgreSQL Server... gitlab # [ 7.470578] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 7.474270] systemd[1]: Starting Permit User Sessions... gitlab # [ 7.482098] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 7.491613] systemd[1]: Finished Permit User Sessions. gitlab # [ 7.494360] systemd[1]: Started Getty on tty1. gitlab # [ 7.497225] systemd[1]: Reached target Login Prompts. gitlab # [ 7.691482] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 7.698153] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 7.700587] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 7.705103] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 7.706785] cfg80211: failed to load regulatory.db gitlab # [ 7.729880] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 7.595387] dhcpcd[765]: eth0: waiting for carrier gitlab # [ 7.596468] dhcpcd[765]: eth0: carrier acquired gitlab # [ 7.599231] dhcpcd[765]: DUID 00:01:00:01:32:19:74:45:52:54:00:12:34:56 gitlab # [ 7.600207] nginx-pre-start[789]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok gitlab # [ 7.600869] nginx-pre-start[789]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful gitlab # [ 7.602051] dhcpcd[765]: eth0: IAID 00:12:34:56 gitlab # [ 7.602510] dhcpcd[765]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 7.608129] systemd[1]: Started Nginx Web Server. gitlab # [ 7.609453] redis-server[790]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 7.612774] redis-server[790]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 7.613418] redis-server[790]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=790, just started gitlab # [ 7.613931] redis-server[790]: Configuration loaded gitlab # [ 7.616470] redis[790]: monotonic clock: POSIX clock_gettime gitlab # [ 7.618753] redis[790]: Running mode=standalone, port=0. gitlab # [ 7.620637] redis[790]: Server initialized gitlab # [ 7.622454] postgresql-pre-start[795]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 7.624190] postgresql-pre-start[795]: This user must also own the server process. gitlab # [ 7.625626] redis[790]: Ready to accept connections unix gitlab # [ 7.626752] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 7.627547] postgresql-pre-start[795]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 7.628719] postgresql-pre-start[795]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 7.629924] postgresql-pre-start[795]: The default text search configuration will be set to "english". gitlab # [ 7.631170] postgresql-pre-start[795]: Data page checksums are enabled. gitlab # [ 7.632767] postgresql-pre-start[795]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 7.633389] postgresql-pre-start[795]: creating subdirectories ... ok gitlab # [ 7.633807] postgresql-pre-start[795]: selecting dynamic shared memory implementation ... posix gitlab # [ 7.634481] redis[790]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 7.664497] postgresql-pre-start[795]: selecting default "max_connections" ... 100 gitlab # [ 7.699297] postgresql-pre-start[795]: selecting default "shared_buffers" ... 128MB gitlab # [ 7.967479] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 8.046610] postgresql-pre-start[795]: selecting default time zone ... UTC gitlab # [ 8.049359] postgresql-pre-start[795]: creating configuration files ... ok gitlab # [ 8.146563] gitlab-workhorse[826]: time="2026-08-20T08:16:06Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 8.147744] gitlab-workhorse[826]: time="2026-08-20T08:16:06Z" level=info msg="Using redis/go-redis" gitlab # [ 8.148635] gitlab-workhorse[826]: time="2026-08-20T08:16:06Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 8.220286] postgresql-pre-start[795]: running bootstrap script ... ok gitlab # [ 8.581988] dhcpcd[765]: eth0: soliciting a DHCP lease gitlab # [ 8.728221] NET: Registered PF_PACKET protocol family gitlab # [ 8.605169] dhcpcd[765]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 8.608463] dhcpcd[765]: eth0: probing address 10.0.2.15/24 gitlab # [ 8.615162] postgresql-pre-start[795]: performing post-bootstrap initialization ... ok gitlab # [ 8.848462] postgresql-pre-start[795]: syncing data to disk ... ok gitlab # [ 8.849609] postgresql-pre-start[795]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 8.850423] postgresql-pre-start[795]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 8.851092] postgresql-pre-start[795]: Success. You can now start the database server using: gitlab # [ 8.851777] postgresql-pre-start[795]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 8.913585] postgres[851]: [851] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 8.915742] postgres[851]: [851] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 8.917784] postgres[851]: [851] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 8.919981] postgres[851]: [851] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 8.933353] postgres[861]: [861] LOG: database system was shut down at 2026-08-20 08:16:06 GMT gitlab # [ 8.940742] postgres[851]: [851] LOG: database system is ready to accept connections gitlab # [ 8.946788] systemd[1]: Started PostgreSQL Server. gitlab # [ 8.949044] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 9.098479] postgresql-setup-start[872]: CREATE DATABASE gitlab # [ 9.118893] postgresql-setup-start[877]: CREATE ROLE gitlab # [ 9.128158] postgresql-setup-start[879]: ALTER DATABASE gitlab # [ 9.147711] postgresql-setup-start[884]: CREATE ROLE gitlab # [ 9.151290] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 9.151988] systemd[1]: Reached target PostgreSQL. gitlab # [ 9.154800] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 9.183848] dhcpcd[765]: eth0: soliciting an IPv6 router gitlab # [ 9.186048] dhcpcd[765]: eth0: Router Advertisement from fe80::2 gitlab # [ 9.187568] dhcpcd[765]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 9.189337] dhcpcd[765]: eth0: adding route to fec0::/64 gitlab # [ 9.191104] dhcpcd[765]: eth0: adding default route via fe80::2 gitlab # [ 9.277584] gitlab-postgresql-start[892]: CREATE DATABASE gitlab # [ 9.331125] gitlab-postgresql-start[898]: CREATE EXTENSION gitlab # [ 9.418091] gitlab-postgresql-start[903]: CREATE EXTENSION gitlab # [ 9.420526] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 9.462631] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[900]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 9.464113] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[900]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 9.503922] systemd[1]: Finished gitlab-config.service. gitlab # [ 9.508479] systemd[1]: Started gitaly.service. gitlab # [ 9.512041] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 9.997726] gitaly[927]: time="2026-08-20T08:16:08.304Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=927 gitlab # [ 9.998882] gitaly[927]: time="2026-08-20T08:16:08.304Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=927 gitlab # [ 9.999675] gitaly[927]: time="2026-08-20T08:16:08.304Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=927 gitlab # [ 10.002579] gitaly[927]: time="2026-08-20T08:16:08.304Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=927 gitlab # [ 10.003696] gitaly[927]: time="2026-08-20T08:16:08.304Z" level=info msg="Starting Gitaly" pid=927 version= gitlab # [ 10.179855] gitaly[927]: time="2026-08-20T08:16:08.487Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=181 pid=927 gitlab # [ 10.181906] gitaly[927]: time="2026-08-20T08:16:08.487Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=927 gitlab # [ 10.183468] gitaly[927]: time="2026-08-20T08:16:08.487Z" level=info msg="finished initializing command factory" duration_ms=0 pid=927 gitlab # [ 10.185191] gitaly[927]: time="2026-08-20T08:16:08.488Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-927/git-exec-2415982292.d/git pid=927 gitlab # [ 10.187142] gitaly[927]: time="2026-08-20T08:16:08.492Z" level=info msg="finished detecting git version" duration_ms=4 pid=927 gitlab # [ 10.188731] gitaly[927]: time="2026-08-20T08:16:08.492Z" level=info msg="using Git version" pid=927 version=2.53.g gitlab # [ 10.190179] gitaly[927]: time="2026-08-20T08:16:08.493Z" level=info msg="clearing disk cache object folder" pid=927 storage=default gitlab # [ 10.191795] gitaly[927]: time="2026-08-20T08:16:08.493Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache163000270 pid=927 storage=default gitlab # [ 10.194220] gitaly[927]: time="2026-08-20T08:16:08.493Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache163000270 pid=927 storage=default gitlab # [ 10.196872] gitaly[927]: time="2026-08-20T08:16:08.493Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=927 gitlab # [ 10.199572] gitaly[927]: time="2026-08-20T08:16:08.493Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=927 gitlab # [ 10.202152] gitaly[927]: time="2026-08-20T08:16:08.493Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache163000270 clear_duration_ms=0 pid=927 storage=default gitlab # [ 10.220966] gitaly[927]: time="2026-08-20T08:16:08.528Z" level=info msg="counting repositories" pid=927 gitlab # [ 10.222294] gitaly[927]: time="2026-08-20T08:16:08.528Z" level=info msg="starting to count repositories" pid=927 storage_path=/var/gitlab/state/repositories gitlab # [ 10.224535] gitaly[927]: time="2026-08-20T08:16:08.528Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=927 storage_path=/var/gitlab/state/repositories gitlab # [ 10.225232] gitaly[927]: time="2026-08-20T08:16:08.528Z" level=info msg="completed counting all repositories" counting_duration=0 pid=927 gitlab # [ 10.226022] gitaly[927]: time="2026-08-20T08:16:08.528Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=927 gitlab # [ 10.226798] gitaly[927]: time="2026-08-20T08:16:08.528Z" level=info msg="finished tempdir cleaner walk" pid=927 storage=default time_ms=0 gitlab # [ 10.227426] gitaly[927]: time="2026-08-20T08:16:08.528Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=927 schema=unix gitlab # [ 10.228122] gitaly[927]: time="2026-08-20T08:16:08.528Z" level=info msg="listening at address" address=/run/gitaly/gitaly-927/sock.d/intern pid=927 schema=unix gitlab # [ 10.228755] gitaly[927]: time="2026-08-20T08:16:08.530Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=927 gitlab # [ 10.229360] gitaly[927]: time="2026-08-20T08:16:08.530Z" level=info msg="Started Gitaly" duration_ms=225 pid=927 gitlab # [ 10.229950] gitaly[927]: time="2026-08-20T08:16:08.530Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=927 gitlab # [ 10.230943] gitaly[927]: time="2026-08-20T08:16:08.530Z" level=info msg="maintenance: daily scheduled" pid=927 scheduled="2026-08-20 12:00:00 +0000 UTC" gitlab # [ 10.997591] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[930]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 10.998944] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[930]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.022440] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[930]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.086473] gitaly[927]: time="2026-08-20T08:16:10.393Z" level=info msg="License database preloaded" duration_ms=2088 pid=927 gitlab # [ 13.624148] dhcpcd[765]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 13.626255] dhcpcd[765]: eth0: adding route to 10.0.2.0/24 gitlab # [ 13.628160] dhcpcd[765]: eth0: adding default route via 10.0.2.2 gitlab # [ 13.739486] systemd[1]: Started DHCP Client. gitlab # [ 13.741131] systemd[1]: Reached target Network is Online. gitlab # [ 41.421882] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[930]: W, [2026-08-20T08:16:39.728578 #930] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 43.667334] postgres[1321]: [1321] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 43.669548] postgres[1321]: [1321] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 43.670817] postgres[1321]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 43.672890] postgres[1321]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 43.674065] postgres[1321]: attidentity AS identity, gitlab # [ 43.675815] postgres[1321]: attgenerated as attgenerated gitlab # [ 43.677937] postgres[1321]: FROM pg_attribute a gitlab # [ 43.680058] postgres[1321]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 43.681480] postgres[1321]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 43.683228] postgres[1321]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 43.684937] postgres[1321]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 43.686376] postgres[1321]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 43.688157] postgres[1321]: ORDER BY a.attnum gitlab # [ 43.689869] postgres[1321]: gitlab # [ 47.807953] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1363]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 47.809112] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1363]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 48.205588] gitlab-workhorse[826]: time="2026-08-20T08:16:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 58.215197] gitlab-workhorse[826]: time="2026-08-20T08:16:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 63.088835] postgres[1438]: [1438] ERROR: relation "table_without_models" does not exist gitlab # [ 63.089878] postgres[1438]: [1438] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 68.221139] gitlab-workhorse[826]: time="2026-08-20T08:17:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 75.078810] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 75.084869] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 75.087611] systemd[1]: Starting gitlab.service... gitlab # [ 75.467345] bundle[1605]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 75.468741] bundle[1605]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 75.469926] bundle[1605]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 78.231639] gitlab-workhorse[826]: time="2026-08-20T08:17:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 78.474623] sidekiq-cluster[1604]: {"severity":"INFO","time":"2026-08-20T08:17:16.762Z","message":"Starting cluster with 1 processes"} gitlab # [ 78.641504] bundle[1605]: {"timestamp":"2026-08-20T08:17:16.919Z","pid":1605,"message":"* Enabling systemd notification integration"} gitlab # [ 78.641878] bundle[1605]: {"timestamp":"2026-08-20T08:17:16.948Z","pid":1605,"message":"Puma starting in cluster mode..."} gitlab # [ 78.642640] bundle[1605]: {"timestamp":"2026-08-20T08:17:16.948Z","pid":1605,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 78.643550] bundle[1605]: {"timestamp":"2026-08-20T08:17:16.950Z","pid":1605,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 78.644333] bundle[1605]: {"timestamp":"2026-08-20T08:17:16.950Z","pid":1605,"message":"* Min threads: 0"} gitlab # [ 78.645177] bundle[1605]: {"timestamp":"2026-08-20T08:17:16.950Z","pid":1605,"message":"* Max threads: 4"} gitlab # [ 78.645883] bundle[1605]: {"timestamp":"2026-08-20T08:17:16.950Z","pid":1605,"message":"* Environment: production"} gitlab # [ 78.646643] bundle[1605]: {"timestamp":"2026-08-20T08:17:16.950Z","pid":1605,"message":"* Master PID: 1605"} gitlab # [ 78.647410] bundle[1605]: {"timestamp":"2026-08-20T08:17:16.950Z","pid":1605,"message":"* Workers: 2"} gitlab # [ 78.648142] bundle[1605]: {"timestamp":"2026-08-20T08:17:16.950Z","pid":1605,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 78.648785] bundle[1605]: {"timestamp":"2026-08-20T08:17:16.950Z","pid":1605,"message":"* Preloading application"} gitlab # [ 88.241716] gitlab-workhorse[826]: time="2026-08-20T08:17:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 98.248572] gitlab-workhorse[826]: time="2026-08-20T08:17:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 104.204958] sidekiq-cluster[1635]: 2026-08-20T08:17:42.511Z pid=1635 tid=wjv INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1635, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434352128} gitlab # [ 104.236361] bundle[1605]: W, [2026-08-20T08:17:42.543079 #1605] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 104.412446] sidekiq-cluster[1635]: W, [2026-08-20T08:17:42.719524 #1635] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 104.459706] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:42.766Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 106.687327] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:44.993Z","message":"GitLab reliable fetch activated!"} gitlab # [ 106.688677] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:44.993Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 106.717536] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.024Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 106.722139] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.029Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 106.727116] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.034Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 106.731508] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.038Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 106.736289] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.043Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 106.742937] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.050Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 106.748317] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.055Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 106.752249] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.059Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 106.755765] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.063Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 106.759385] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.066Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 106.762718] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.070Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 106.767300] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.074Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 106.773795] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.081Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 106.779202] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.086Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 106.785295] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.092Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 106.791663] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.099Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 106.798378] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.105Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 106.804497] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.111Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 106.810961] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.118Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 106.817340] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.124Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 106.823729] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.131Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 106.829821] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.137Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 106.835360] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.142Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 106.841497] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.148Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 106.846759] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.154Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 106.853093] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.160Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 106.858458] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.165Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 106.863811] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.171Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 106.869385] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.176Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 106.875188] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.182Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 106.880739] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.188Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 106.886807] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.194Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 106.892091] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.199Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 106.897347] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.204Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 106.902393] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.209Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 106.907266] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.214Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 106.912833] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.220Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 106.918307] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.225Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 106.923080] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.230Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 106.929977] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.237Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 106.936748] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.244Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 106.941658] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.249Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 106.946259] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.253Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 106.949833] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.257Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 106.953262] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.260Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 106.955842] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.263Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 106.958176] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.265Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 106.960556] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.267Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 106.963365] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.270Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 106.966487] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.273Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 106.968639] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.276Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 106.974267] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.281Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 106.984034] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.291Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 106.987364] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.294Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 106.989588] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.297Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 106.991925] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.299Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 106.993920] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.301Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 106.995926] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.303Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 106.997867] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.304Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 106.999973] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.306Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 107.003115] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.310Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 107.006992] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.314Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 107.011823] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.319Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 107.019376] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.326Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 107.022940] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.330Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 107.026434] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.333Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 107.029430] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.336Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 107.032417] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.339Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 107.035102] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.342Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 107.037934] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.345Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 107.082675] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.390Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 107.085739] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.393Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 107.088178] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.395Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 107.090074] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.397Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 107.093558] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.400Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 107.096717] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.404Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 107.100763] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.408Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 107.103934] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.411Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 107.107188] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.414Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 107.109127] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.416Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 107.110968] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.418Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 107.113325] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.420Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 107.115774] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.423Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 107.120267] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.427Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 107.124556] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.432Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 107.126937] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.434Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 107.129352] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.436Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 107.131854] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.439Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 107.133829] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.441Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 107.136262] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.443Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 107.138038] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.445Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 107.139911] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.447Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 107.142443] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.449Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 107.144441] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.451Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 107.147047] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.454Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 107.149240] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.456Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 107.151076] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.458Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 107.152966] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.460Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 107.162790] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.470Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 107.164791] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.472Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 107.166743] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.474Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 107.169358] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.476Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 107.172178] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.479Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 107.174280] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.481Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 107.176917] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.484Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 107.178839] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.486Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 107.181397] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.488Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 107.183817] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.491Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 107.186227] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:17:45.493Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 108.255568] gitlab-workhorse[826]: time="2026-08-20T08:17:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 109.394968] sidekiq-cluster[1635]: InitializerConnections Query: SET client_min_messages TO 'warning' gitlab # [ 109.396571] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 109.398245] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 109.399379] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 109.400388] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 109.401424] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 109.402799] sidekiq-cluster[1635]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 109.404334] sidekiq-cluster[1635]: InitializerConnections Query: SET standard_conforming_strings = on gitlab # [ 109.405344] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 109.406409] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 109.407791] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 109.409255] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 109.410333] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 109.411422] sidekiq-cluster[1635]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 109.442066] sidekiq-cluster[1635]: InitializerConnections Query: SET intervalstyle = iso_8601 gitlab # [ 109.442983] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 109.443618] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 109.444386] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 109.445091] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 109.445746] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 109.446525] sidekiq-cluster[1635]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 109.451995] sidekiq-cluster[1635]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname gitlab # [ 109.452902] sidekiq-cluster[1635]: FROM pg_type as t gitlab # [ 109.453656] sidekiq-cluster[1635]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz') gitlab # [ 109.454442] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 109.455110] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 109.455669] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 109.456426] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 109.457088] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 109.457694] sidekiq-cluster[1635]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 109.464539] sidekiq-cluster[1635]: InitializerConnections Query: SET SESSION timezone TO 'UTC' gitlab # [ 109.465569] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 109.466547] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 109.466987] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 109.467603] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 109.468283] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 109.468883] sidekiq-cluster[1635]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 109.477937] sidekiq-cluster[1635]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics' gitlab # [ 109.478857] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 109.479569] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 109.480059] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 109.480624] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 109.481239] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 109.481833] sidekiq-cluster[1635]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 118.263440] gitlab-workhorse[826]: time="2026-08-20T08:17:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 128.268509] gitlab-workhorse[826]: time="2026-08-20T08:18:06Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 130.611739] postgres[2109]: [2109] ERROR: relation "table_without_models" does not exist gitlab # [ 130.614534] postgres[2109]: [2109] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 132.066081] sidekiq-cluster[1635]: InitializerConnections Query: SET client_min_messages TO 'warning' gitlab # [ 132.068941] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 132.073230] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 132.075623] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 132.078107] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 132.080272] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 132.082475] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 132.085294] sidekiq-cluster[1635]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 132.096665] sidekiq-cluster[1635]: InitializerConnections Query: SET standard_conforming_strings = on gitlab # [ 132.098918] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 132.101454] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 132.103818] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 132.104679] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 132.105819] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 132.106955] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 132.108161] sidekiq-cluster[1635]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 132.109047] sidekiq-cluster[1635]: InitializerConnections Query: SET intervalstyle = iso_8601 gitlab # [ 132.110718] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 132.111413] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 132.111878] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 132.112507] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 132.112989] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 132.113569] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 132.114066] sidekiq-cluster[1635]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 132.135403] sidekiq-cluster[1635]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname gitlab # [ 132.137209] sidekiq-cluster[1635]: FROM pg_type as t gitlab # [ 132.137802] sidekiq-cluster[1635]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz') gitlab # [ 132.139803] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 132.140721] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 132.141516] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 132.142194] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 132.142843] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 132.143585] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 132.144261] sidekiq-cluster[1635]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 132.145138] sidekiq-cluster[1635]: InitializerConnections Query: SET SESSION timezone TO 'UTC' gitlab # [ 132.145787] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 132.146419] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 132.147100] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 132.147827] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 132.148636] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 132.149251] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 132.149860] sidekiq-cluster[1635]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 132.151189] sidekiq-cluster[1635]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'sidekiq_throttling_middleware' gitlab # [ 132.151930] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 132.152713] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 132.153400] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 132.154149] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 132.154749] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 132.155406] sidekiq-cluster[1635]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 132.156134] sidekiq-cluster[1635]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 132.766393] postgres[2140]: [2140] ERROR: relation "table_without_models" does not exist gitlab # [ 132.768942] postgres[2140]: [2140] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 133.135865] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:11.439Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 133.143514] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:11.450Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 133.144508] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:11.450Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 133.145268] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:11.450Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 133.150171] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:11.457Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 134.649124] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:12.955Z","message":"Cleaning working queues"} gitlab # [ 134.650741] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:12.957Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"21b301ca2f4ddba77b3b9a23","created_at":"2026-08-20T08:17:13.045Z","trace_propagation_headers":{"sentry-trace":"d12b8fc08b9144e58e5365c180cedf2b-5cd8aca7e67540f7","baggage":"sentry-trace_id=d12b8fc08b9144e58e5365c180cedf2b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"3631ca66747eedd8aab7a1054d759e94","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:17:13.052Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-21b301ca2f4ddba77b3b9a23: start","job_status":"start","queue_duration_s":59.904582,"scheduling_latency_s":59.904736} gitlab # [ 134.842683] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:13.149Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"21b301ca2f4ddba77b3b9a23","created_at":"2026-08-20T08:17:13.045Z","trace_propagation_headers":{"sentry-trace":"d12b8fc08b9144e58e5365c180cedf2b-5cd8aca7e67540f7","baggage":"sentry-trace_id=d12b8fc08b9144e58e5365c180cedf2b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"3631ca66747eedd8aab7a1054d759e94","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:17:13.052Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-21b301ca2f4ddba77b3b9a23: done: 0.192292 sec","job_status":"done","queue_duration_s":59.904582,"scheduling_latency_s":59.904736,"redis_calls":29,"redis_duration_s":0.008027,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.004613,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001867,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001547,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09790574,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.192292,"completed_at":"2026-08-20T08:18:13.149Z","load_balancing_strategy":"primary","db_duration_s":0.064647,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 135.760804] bundle[1605]: {"timestamp":"2026-08-20T08:18:14.067Z","pid":1605,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 135.761906] bundle[1605]: {"timestamp":"2026-08-20T08:18:14.067Z","pid":1605,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 135.762687] bundle[1605]: {"timestamp":"2026-08-20T08:18:14.067Z","pid":1605,"message":"! #\u003cThread:0x00007880ac9e8860 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 135.763747] bundle[1605]: {"timestamp":"2026-08-20T08:18:14.067Z","pid":1605,"message":"! #\u003cThread:0x00007880acc085a0 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 135.764483] bundle[1605]: {"timestamp":"2026-08-20T08:18:14.067Z","pid":1605,"message":"Use Ctrl-C to stop"} gitlab # [ 135.765192] bundle[1605]: {"timestamp":"2026-08-20T08:18:14.068Z","pid":1605,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 136.124960] bundle[1605]: {"timestamp":"2026-08-20T08:18:14.431Z","pid":1605,"message":"- Worker 0 (PID: 2204) booted in 0.3s, phase: 0"} gitlab # [ 136.172585] bundle[1605]: {"timestamp":"2026-08-20T08:18:14.479Z","pid":1605,"message":"- Worker 1 (PID: 2208) booted in 0.32s, phase: 0"} gitlab # [ 136.177565] systemd[1]: Started gitlab.service. gitlab # [ 136.178712] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 136.182208] systemd[1]: Starting setup-gitlab.service... gitlab # [ 136.211847] setup-gitlab-start[2232]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 138.784706] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:18:17 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 2534 gitlab # [ 138.789604] setup-gitlab-start[2232]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 138.792149] setup-gitlab-start[2232]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 138.803601] runuser[2258]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 139.171933] setup-gitlab-start[2259]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 139.173529] setup-gitlab-start[2259]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 139.175260] setup-gitlab-start[2259]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 139.742099] setup-gitlab-start[2259]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 139.743972] setup-gitlab-start[2259]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 139.745411] setup-gitlab-start[2259]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 146.700135] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"b8ecc65f2e156e9a76d9dfa1","created_at":"2026-08-20T08:18:24.972Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"acf35d478a74cb8c6adb0eeb1e7c80d3","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.003Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-b8ecc65f2e156e9a76d9dfa1: start","job_status":"start","queue_duration_s":0.002457,"scheduling_latency_s":0.002496} gitlab # [ 146.749711] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.056Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"b8ecc65f2e156e9a76d9dfa1","created_at":"2026-08-20T08:18:24.972Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"acf35d478a74cb8c6adb0eeb1e7c80d3","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.003Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-b8ecc65f2e156e9a76d9dfa1: done: 0.050603 sec","job_status":"done","queue_duration_s":0.002457,"scheduling_latency_s":0.002496,"redis_calls":10,"redis_duration_s":0.008461999999999999,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000652,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005508,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000284114,"duration_s":0.050603,"completed_at":"2026-08-20T08:18:25.056Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008536,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.793306] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.057Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4b176757ded9afec7431deba","created_at":"2026-08-20T08:18:25.012Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ecb4906e21e07c654f43d9b927f44f7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.032Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4b176757ded9afec7431deba: start","job_status":"start","queue_duration_s":0.025386,"scheduling_latency_s":0.0254} gitlab # [ 146.794867] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.072Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4b176757ded9afec7431deba","created_at":"2026-08-20T08:18:25.012Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ecb4906e21e07c654f43d9b927f44f7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.032Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4b176757ded9afec7431deba: done: 0.01478 sec","job_status":"done","queue_duration_s":0.025386,"scheduling_latency_s":0.0254,"redis_calls":12,"redis_duration_s":0.001503,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000488,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210362,"duration_s":0.01478,"completed_at":"2026-08-20T08:18:25.072Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001202,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.822035] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.090Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0074def38e4b29efd3049ee2","created_at":"2026-08-20T08:18:25.046Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.086Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0074def38e4b29efd3049ee2: start","job_status":"start","queue_duration_s":0.003065,"scheduling_latency_s":0.003136} gitlab # [ 147.195823] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.502Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0074def38e4b29efd3049ee2","created_at":"2026-08-20T08:18:25.046Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.086Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0074def38e4b29efd3049ee2: done: 0.412496 sec","job_status":"done","queue_duration_s":0.003065,"scheduling_latency_s":0.003136,"redis_calls":71,"redis_duration_s":0.140905,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.007323,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.013235,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.09112,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.029227,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.122901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001175009,"duration_s":0.412496,"completed_at":"2026-08-20T08:18:25.502Z","load_balancing_strategy":"primary","db_duration_s":0.011092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.239074] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"500ff5dd2b6a24c8cd9d329d","created_at":"2026-08-20T08:18:25.097Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1368b8b1018766c3708103b169cb8b8","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.189Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-500ff5dd2b6a24c8cd9d329d: start","job_status":"start","queue_duration_s":0.356797,"scheduling_latency_s":0.356839} gitlab # [ 147.303630] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"500ff5dd2b6a24c8cd9d329d","created_at":"2026-08-20T08:18:25.097Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1368b8b1018766c3708103b169cb8b8","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.189Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-500ff5dd2b6a24c8cd9d329d: done: 0.064075 sec","job_status":"done","queue_duration_s":0.356797,"scheduling_latency_s":0.356839,"redis_calls":12,"redis_duration_s":0.019647,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.011304,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005248,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001653283,"exclusive_lock_hold_duration_s":0.006771811,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.064075,"completed_at":"2026-08-20T08:18:25.609Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005854,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.323849] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.617Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"a72bb20975c1506f6e47552c","created_at":"2026-08-20T08:18:25.226Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"38dfde9ecbbe2c3eaa51e96c46f7ccaf","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.234Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-a72bb20975c1506f6e47552c: start","job_status":"start","queue_duration_s":0.382767,"scheduling_latency_s":0.382807} gitlab # [ 147.428564] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.735Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"a72bb20975c1506f6e47552c","created_at":"2026-08-20T08:18:25.226Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"38dfde9ecbbe2c3eaa51e96c46f7ccaf","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.234Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-a72bb20975c1506f6e47552c: done: 0.117352 sec","job_status":"done","queue_duration_s":0.382767,"scheduling_latency_s":0.382807,"redis_calls":12,"redis_duration_s":0.040206,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002605,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.032447,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005154,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002658997,"exclusive_lock_hold_duration_s":0.033688639000000006,"duration_s":0.117352,"completed_at":"2026-08-20T08:18:25.734Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028098,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.467071] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.741Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"4ef96ae417d5d8fa0d3b25ec","created_at":"2026-08-20T08:18:25.249Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11bace400b993e4f175dff5376ab5011","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.260Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-4ef96ae417d5d8fa0d3b25ec: start","job_status":"start","queue_duration_s":0.480964,"scheduling_latency_s":0.481006} gitlab # [ 147.485474] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"4ef96ae417d5d8fa0d3b25ec","created_at":"2026-08-20T08:18:25.249Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11bace400b993e4f175dff5376ab5011","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.260Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-4ef96ae417d5d8fa0d3b25ec: done: 0.050645 sec","job_status":"done","queue_duration_s":0.480964,"scheduling_latency_s":0.481006,"redis_calls":12,"redis_duration_s":0.004406,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000626,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001953,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001827,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000789485,"exclusive_lock_hold_duration_s":0.016799620999999997,"duration_s":0.050645,"completed_at":"2026-08-20T08:18:25.792Z","load_balancing_strategy":"primary","db_duration_s":0.010775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.491698] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2fdfa0376430246dd6368343","created_at":"2026-08-20T08:18:25.285Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f11b9be7472a57788ef708cdba83e58b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.294Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2fdfa0376430246dd6368343: start","job_status":"start","queue_duration_s":0.499789,"scheduling_latency_s":0.499866} gitlab # [ 147.504559] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.806Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 147.507157] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.812Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2fdfa0376430246dd6368343","created_at":"2026-08-20T08:18:25.285Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f11b9be7472a57788ef708cdba83e58b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.294Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2fdfa0376430246dd6368343: done: 0.017703 sec","job_status":"done","queue_duration_s":0.499789,"scheduling_latency_s":0.499866,"redis_calls":10,"redis_duration_s":0.001471,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000226845,"duration_s":0.017703,"completed_at":"2026-08-20T08:18:25.812Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.556596] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"fff6477215d8dbc8fbb15d53","created_at":"2026-08-20T08:18:25.303Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3de0ce6cb06c364dba1894a29eaf4bd2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.313Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-fff6477215d8dbc8fbb15d53: start","job_status":"start","queue_duration_s":0.499508,"scheduling_latency_s":0.499523} gitlab # [ 147.557391] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.827Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"fff6477215d8dbc8fbb15d53","created_at":"2026-08-20T08:18:25.303Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3de0ce6cb06c364dba1894a29eaf4bd2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.313Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-fff6477215d8dbc8fbb15d53: done: 0.013791 sec","job_status":"done","queue_duration_s":0.499508,"scheduling_latency_s":0.499523,"redis_calls":10,"redis_duration_s":0.0013809999999999998,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224609,"duration_s":0.013791,"completed_at":"2026-08-20T08:18:25.827Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000633,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.599655] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.828Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e21a4ef4ce3ee6eac1e0a866","created_at":"2026-08-20T08:18:25.326Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6abef5933c25e9b4bfd72efa8c8ded6","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.336Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e21a4ef4ce3ee6eac1e0a866: start","job_status":"start","queue_duration_s":0.492264,"scheduling_latency_s":0.49228} gitlab # [ 147.635721] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e21a4ef4ce3ee6eac1e0a866","created_at":"2026-08-20T08:18:25.326Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6abef5933c25e9b4bfd72efa8c8ded6","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.336Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e21a4ef4ce3ee6eac1e0a866: done: 0.017263 sec","job_status":"done","queue_duration_s":0.492264,"scheduling_latency_s":0.49228,"redis_calls":10,"redis_duration_s":0.001451,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000306,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000315,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224889,"duration_s":0.017263,"completed_at":"2026-08-20T08:18:25.845Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.636656] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.846Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"fa5d1c5a0e97b38a620ff20f","created_at":"2026-08-20T08:18:25.348Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c9dbd933f9209bc136fd383430b094f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.356Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-fa5d1c5a0e97b38a620ff20f: start","job_status":"start","queue_duration_s":0.489943,"scheduling_latency_s":0.489959} gitlab # [ 147.681858] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.880Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"fa5d1c5a0e97b38a620ff20f","created_at":"2026-08-20T08:18:25.348Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c9dbd933f9209bc136fd383430b094f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.356Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-fa5d1c5a0e97b38a620ff20f: done: 0.033445 sec","job_status":"done","queue_duration_s":0.489943,"scheduling_latency_s":0.489959,"redis_calls":16,"redis_duration_s":0.00222,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001097,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000253105,"duration_s":0.033445,"completed_at":"2026-08-20T08:18:25.880Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010517,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.682922] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.881Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8ab59d73a8088a7434a804cd","created_at":"2026-08-20T08:18:25.366Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5992cc676925da546baead6b2630b672","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.382Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8ab59d73a8088a7434a804cd: start","job_status":"start","queue_duration_s":0.499145,"scheduling_latency_s":0.49916} gitlab # [ 147.727458] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.890Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 147.728180] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.895Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8ab59d73a8088a7434a804cd","created_at":"2026-08-20T08:18:25.366Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5992cc676925da546baead6b2630b672","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.382Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8ab59d73a8088a7434a804cd: done: 0.014584 sec","job_status":"done","queue_duration_s":0.499145,"scheduling_latency_s":0.49916,"redis_calls":10,"redis_duration_s":0.00219,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00033,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001555,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000305,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224609,"duration_s":0.014584,"completed_at":"2026-08-20T08:18:25.895Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00027,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.733632] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.896Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0b2bec60b8c50328aaecf2d5","created_at":"2026-08-20T08:18:25.391Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff673cbaa2e326c4e47759f3fa685fdb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:18:25.402Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0b2bec60b8c50328aaecf2d5: start","job_status":"start","queue_duration_s":0.494795,"scheduling_latency_s":0.494809} gitlab # [ 147.745250] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.919Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0b2bec60b8c50328aaecf2d5","created_at":"2026-08-20T08:18:25.391Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff673cbaa2e326c4e47759f3fa685fdb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:18:25.402Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0b2bec60b8c50328aaecf2d5: done: 0.022525 sec","job_status":"done","queue_duration_s":0.494795,"scheduling_latency_s":0.494809,"redis_calls":10,"redis_duration_s":0.001498,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00031,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000343,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000258133,"duration_s":0.022525,"completed_at":"2026-08-20T08:18:25.919Z","load_balancing_strategy":"primary","db_duration_s":0.002431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.788490] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"8f5270a2982af5ad6f3b1721","created_at":"2026-08-20T08:18:25.430Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2951f66b11a60ee54ce2e7e7de4fdc8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.443Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-8f5270a2982af5ad6f3b1721: start","job_status":"start","queue_duration_s":0.477105,"scheduling_latency_s":0.477122} gitlab # [ 147.796236] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.934Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"8f5270a2982af5ad6f3b1721","created_at":"2026-08-20T08:18:25.430Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2951f66b11a60ee54ce2e7e7de4fdc8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.443Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-8f5270a2982af5ad6f3b1721: done: 0.013836 sec","job_status":"done","queue_duration_s":0.477105,"scheduling_latency_s":0.477122,"redis_calls":12,"redis_duration_s":0.001709,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000601,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217346,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.013836,"completed_at":"2026-08-20T08:18:25.934Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.835947] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.935Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"763f6a89ac66aeb76d1568f7","created_at":"2026-08-20T08:18:25.454Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b64e46fcdefbc7867477ed5f22f478dd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.466Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-763f6a89ac66aeb76d1568f7: start","job_status":"start","queue_duration_s":0.468858,"scheduling_latency_s":0.468872} gitlab # [ 147.841683] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.962Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"763f6a89ac66aeb76d1568f7","created_at":"2026-08-20T08:18:25.454Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b64e46fcdefbc7867477ed5f22f478dd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.466Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-763f6a89ac66aeb76d1568f7: done: 0.026476 sec","job_status":"done","queue_duration_s":0.468858,"scheduling_latency_s":0.468872,"redis_calls":19,"redis_duration_s":0.0029189999999999997,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000579,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000412,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001478,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00045,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222374,"duration_s":0.026476,"completed_at":"2026-08-20T08:18:25.962Z","load_balancing_strategy":"primary","db_duration_s":0.003274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.883813] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90887a6b6c938f12dfe688b0","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90887a6b6c938f12dfe688b0: start","job_status":"start","queue_duration_s":0.491274,"scheduling_latency_s":0.49129} gitlab # [ 147.888595] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90887a6b6c938f12dfe688b0","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90887a6b6c938f12dfe688b0: done: 0.015889 sec","job_status":"done","queue_duration_s":0.491274,"scheduling_latency_s":0.49129,"redis_calls":16,"redis_duration_s":0.00241,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001453,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000249473,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015889,"completed_at":"2026-08-20T08:18:25.978Z","load_balancing_strategy":"primary","db_duration_s":0.000291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.949219] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2480fed2dd35a99fb66fb478","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2480fed2dd35a99fb66fb478: start","job_status":"start","queue_duration_s":0.508273,"scheduling_latency_s":0.508289} gitlab # [ 147.949968] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2480fed2dd35a99fb66fb478","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2480fed2dd35a99fb66fb478: done: 0.011623 sec","job_status":"done","queue_duration_s":0.508273,"scheduling_latency_s":0.508289,"redis_calls":13,"redis_duration_s":0.002137,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001571,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011623,"completed_at":"2026-08-20T08:18:25.991Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.967768] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:25.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"263dac08930abd93e4805e21","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-263dac08930abd93e4805e21: start","job_status":"start","queue_duration_s":0.520875,"scheduling_latency_s":0.520891} gitlab # [ 148.009740] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"263dac08930abd93e4805e21","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-263dac08930abd93e4805e21: done: 0.010908 sec","job_status":"done","queue_duration_s":0.520875,"scheduling_latency_s":0.520891,"redis_calls":13,"redis_duration_s":0.001929,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001362,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010908,"completed_at":"2026-08-20T08:18:26.003Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.011680] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d769477907a8aa36fa8d230d","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d769477907a8aa36fa8d230d: start","job_status":"start","queue_duration_s":0.532743,"scheduling_latency_s":0.53276} gitlab # [ 148.022646] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d769477907a8aa36fa8d230d","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d769477907a8aa36fa8d230d: done: 0.010774 sec","job_status":"done","queue_duration_s":0.532743,"scheduling_latency_s":0.53276,"redis_calls":13,"redis_duration_s":0.0017039999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010774,"completed_at":"2026-08-20T08:18:26.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.056619] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebf9432c90216e97c4f5fd7d","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebf9432c90216e97c4f5fd7d: start","job_status":"start","queue_duration_s":0.544454,"scheduling_latency_s":0.544469} gitlab # [ 148.067655] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebf9432c90216e97c4f5fd7d","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebf9432c90216e97c4f5fd7d: done: 0.010767 sec","job_status":"done","queue_duration_s":0.544454,"scheduling_latency_s":0.544469,"redis_calls":13,"redis_duration_s":0.0018050000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001146,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010767,"completed_at":"2026-08-20T08:18:26.027Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.115793] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37203352eec4ad1e261c5c78","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37203352eec4ad1e261c5c78: start","job_status":"start","queue_duration_s":0.556351,"scheduling_latency_s":0.556365} gitlab # [ 148.116658] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37203352eec4ad1e261c5c78","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37203352eec4ad1e261c5c78: done: 0.010557 sec","job_status":"done","queue_duration_s":0.556351,"scheduling_latency_s":0.556365,"redis_calls":13,"redis_duration_s":0.0017399999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001171,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010557,"completed_at":"2026-08-20T08:18:26.038Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.154508] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f27cd08fc16c5afce8e15f12","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f27cd08fc16c5afce8e15f12: start","job_status":"start","queue_duration_s":0.568017,"scheduling_latency_s":0.568031} gitlab # [ 148.155388] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f27cd08fc16c5afce8e15f12","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f27cd08fc16c5afce8e15f12: done: 0.010486 sec","job_status":"done","queue_duration_s":0.568017,"scheduling_latency_s":0.568031,"redis_calls":13,"redis_duration_s":0.001662,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010486,"completed_at":"2026-08-20T08:18:26.050Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.196934] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdedea99e017ab89a397fc12","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdedea99e017ab89a397fc12: start","job_status":"start","queue_duration_s":0.579575,"scheduling_latency_s":0.57959} gitlab # [ 148.198452] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdedea99e017ab89a397fc12","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdedea99e017ab89a397fc12: done: 0.010889 sec","job_status":"done","queue_duration_s":0.579575,"scheduling_latency_s":0.57959,"redis_calls":13,"redis_duration_s":0.002006,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000785,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010889,"completed_at":"2026-08-20T08:18:26.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.243164] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7560a59a120565a57eeb6958","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7560a59a120565a57eeb6958: start","job_status":"start","queue_duration_s":0.591596,"scheduling_latency_s":0.59161} gitlab # [ 148.243806] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7560a59a120565a57eeb6958","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7560a59a120565a57eeb6958: done: 0.010583 sec","job_status":"done","queue_duration_s":0.591596,"scheduling_latency_s":0.59161,"redis_calls":13,"redis_duration_s":0.001707,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010583,"completed_at":"2026-08-20T08:18:26.073Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.286634] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32b14530230787b238dae464","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32b14530230787b238dae464: start","job_status":"start","queue_duration_s":0.60328,"scheduling_latency_s":0.603295} gitlab # [ 148.287480] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32b14530230787b238dae464","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32b14530230787b238dae464: done: 0.010808 sec","job_status":"done","queue_duration_s":0.60328,"scheduling_latency_s":0.603295,"redis_calls":13,"redis_duration_s":0.002023,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000811,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010808,"completed_at":"2026-08-20T08:18:26.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.326220] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43c4692616c6918bd57cf582","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43c4692616c6918bd57cf582: start","job_status":"start","queue_duration_s":0.615188,"scheduling_latency_s":0.615204} gitlab # [ 148.327441] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43c4692616c6918bd57cf582","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43c4692616c6918bd57cf582: done: 0.010742 sec","job_status":"done","queue_duration_s":0.615188,"scheduling_latency_s":0.615204,"redis_calls":13,"redis_duration_s":0.001721,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001157,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010742,"completed_at":"2026-08-20T08:18:26.097Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.378114] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"989374bfeece182277ccf74f","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-989374bfeece182277ccf74f: start","job_status":"start","queue_duration_s":0.626862,"scheduling_latency_s":0.626877} gitlab # [ 148.378769] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"989374bfeece182277ccf74f","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-989374bfeece182277ccf74f: done: 0.010625 sec","job_status":"done","queue_duration_s":0.626862,"scheduling_latency_s":0.626877,"redis_calls":13,"redis_duration_s":0.001774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010625,"completed_at":"2026-08-20T08:18:26.109Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.428812] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc08a0aee060847fcd196d4d","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc08a0aee060847fcd196d4d: start","job_status":"start","queue_duration_s":0.63849,"scheduling_latency_s":0.638505} gitlab # [ 148.429714] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc08a0aee060847fcd196d4d","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc08a0aee060847fcd196d4d: done: 0.01146 sec","job_status":"done","queue_duration_s":0.63849,"scheduling_latency_s":0.638505,"redis_calls":13,"redis_duration_s":0.001802,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01146,"completed_at":"2026-08-20T08:18:26.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.468896] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"545ccf97ab8cea08a36a79fd","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-545ccf97ab8cea08a36a79fd: start","job_status":"start","queue_duration_s":0.650869,"scheduling_latency_s":0.650884} gitlab # [ 148.469588] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"545ccf97ab8cea08a36a79fd","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-545ccf97ab8cea08a36a79fd: done: 0.010759 sec","job_status":"done","queue_duration_s":0.650869,"scheduling_latency_s":0.650884,"redis_calls":13,"redis_duration_s":0.001818,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010759,"completed_at":"2026-08-20T08:18:26.133Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.507112] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4592ac24f32840a49d25aa31","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4592ac24f32840a49d25aa31: start","job_status":"start","queue_duration_s":0.662767,"scheduling_latency_s":0.662783} gitlab # [ 148.507757] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4592ac24f32840a49d25aa31","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4592ac24f32840a49d25aa31: done: 0.010851 sec","job_status":"done","queue_duration_s":0.662767,"scheduling_latency_s":0.662783,"redis_calls":13,"redis_duration_s":0.001789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001217,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010851,"completed_at":"2026-08-20T08:18:26.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.548217] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40a42a9287f735e466ddb1de","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40a42a9287f735e466ddb1de: start","job_status":"start","queue_duration_s":0.674503,"scheduling_latency_s":0.674518} gitlab # [ 148.549178] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40a42a9287f735e466ddb1de","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40a42a9287f735e466ddb1de: done: 0.010464 sec","job_status":"done","queue_duration_s":0.674503,"scheduling_latency_s":0.674518,"redis_calls":13,"redis_duration_s":0.0016910000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010464,"completed_at":"2026-08-20T08:18:26.156Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.597288] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"504c35959041c22c908c38ec","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-504c35959041c22c908c38ec: start","job_status":"start","queue_duration_s":0.686069,"scheduling_latency_s":0.686087} gitlab # [ 148.598045] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"504c35959041c22c908c38ec","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-504c35959041c22c908c38ec: done: 0.010545 sec","job_status":"done","queue_duration_s":0.686069,"scheduling_latency_s":0.686087,"redis_calls":13,"redis_duration_s":0.001758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010545,"completed_at":"2026-08-20T08:18:26.168Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.641687] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee12d1b1b78143efce1b8150","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee12d1b1b78143efce1b8150: start","job_status":"start","queue_duration_s":0.697761,"scheduling_latency_s":0.697777} gitlab # [ 148.642594] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee12d1b1b78143efce1b8150","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee12d1b1b78143efce1b8150: done: 0.010877 sec","job_status":"done","queue_duration_s":0.697761,"scheduling_latency_s":0.697777,"redis_calls":13,"redis_duration_s":0.001702,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010877,"completed_at":"2026-08-20T08:18:26.180Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.690104] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff3429dae7c9a907480ef8e7","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff3429dae7c9a907480ef8e7: start","job_status":"start","queue_duration_s":0.709744,"scheduling_latency_s":0.70976} gitlab # [ 148.690789] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff3429dae7c9a907480ef8e7","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff3429dae7c9a907480ef8e7: done: 0.010825 sec","job_status":"done","queue_duration_s":0.709744,"scheduling_latency_s":0.70976,"redis_calls":13,"redis_duration_s":0.001976,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001411,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010825,"completed_at":"2026-08-20T08:18:26.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.735799] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1771185dd3f6b513847f5b95","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1771185dd3f6b513847f5b95: start","job_status":"start","queue_duration_s":0.721752,"scheduling_latency_s":0.721766} gitlab # [ 148.736550] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1771185dd3f6b513847f5b95","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1771185dd3f6b513847f5b95: done: 0.010624 sec","job_status":"done","queue_duration_s":0.721752,"scheduling_latency_s":0.721766,"redis_calls":13,"redis_duration_s":0.0017959999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001171,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010624,"completed_at":"2026-08-20T08:18:26.204Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.749461] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42301fa17933d0a757279af6","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42301fa17933d0a757279af6: start","job_status":"start","queue_duration_s":0.733583,"scheduling_latency_s":0.733599} gitlab # [ 148.760676] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42301fa17933d0a757279af6","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42301fa17933d0a757279af6: done: 0.010834 sec","job_status":"done","queue_duration_s":0.733583,"scheduling_latency_s":0.733599,"redis_calls":13,"redis_duration_s":0.001787,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010834,"completed_at":"2026-08-20T08:18:26.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.807453] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8638fd034cf3ece82852ac1e","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8638fd034cf3ece82852ac1e: start","job_status":"start","queue_duration_s":0.745335,"scheduling_latency_s":0.745349} gitlab # [ 148.808228] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8638fd034cf3ece82852ac1e","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8638fd034cf3ece82852ac1e: done: 0.010885 sec","job_status":"done","queue_duration_s":0.745335,"scheduling_latency_s":0.745349,"redis_calls":13,"redis_duration_s":0.0017659999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010885,"completed_at":"2026-08-20T08:18:26.228Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.838198] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4d54f615f98f1161498884f","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4d54f615f98f1161498884f: start","job_status":"start","queue_duration_s":0.757139,"scheduling_latency_s":0.757154} gitlab # [ 148.848484] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4d54f615f98f1161498884f","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4d54f615f98f1161498884f: done: 0.010805 sec","job_status":"done","queue_duration_s":0.757139,"scheduling_latency_s":0.757154,"redis_calls":13,"redis_duration_s":0.001807,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001213,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010805,"completed_at":"2026-08-20T08:18:26.239Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.885868] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbb4b2e332497e33e1d3801d","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbb4b2e332497e33e1d3801d: start","job_status":"start","queue_duration_s":0.768892,"scheduling_latency_s":0.768906} gitlab # [ 148.891662] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbb4b2e332497e33e1d3801d","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbb4b2e332497e33e1d3801d: done: 0.010737 sec","job_status":"done","queue_duration_s":0.768892,"scheduling_latency_s":0.768906,"redis_calls":13,"redis_duration_s":0.001769,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001209,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010737,"completed_at":"2026-08-20T08:18:26.251Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.939632] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01385b6497c70955f56e5b2d","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01385b6497c70955f56e5b2d: start","job_status":"start","queue_duration_s":0.780747,"scheduling_latency_s":0.780763} gitlab # [ 148.940440] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01385b6497c70955f56e5b2d","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01385b6497c70955f56e5b2d: done: 0.01071 sec","job_status":"done","queue_duration_s":0.780747,"scheduling_latency_s":0.780763,"redis_calls":13,"redis_duration_s":0.001797,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000607,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01071,"completed_at":"2026-08-20T08:18:26.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.983597] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c22db71ba8eb543c2c42a040","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c22db71ba8eb543c2c42a040: start","job_status":"start","queue_duration_s":0.792358,"scheduling_latency_s":0.792372} gitlab # [ 148.984418] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c22db71ba8eb543c2c42a040","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c22db71ba8eb543c2c42a040: done: 0.011006 sec","job_status":"done","queue_duration_s":0.792358,"scheduling_latency_s":0.792372,"redis_calls":13,"redis_duration_s":0.001874,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011006,"completed_at":"2026-08-20T08:18:26.275Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.036061] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e90b386390812f7bf8cdc0af","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e90b386390812f7bf8cdc0af: start","job_status":"start","queue_duration_s":0.804341,"scheduling_latency_s":0.804355} gitlab # [ 149.036740] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e90b386390812f7bf8cdc0af","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e90b386390812f7bf8cdc0af: done: 0.010711 sec","job_status":"done","queue_duration_s":0.804341,"scheduling_latency_s":0.804355,"redis_calls":13,"redis_duration_s":0.0021060000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001363,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010711,"completed_at":"2026-08-20T08:18:26.286Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.078056] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6b78e8665e1ce4eb5e17961","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6b78e8665e1ce4eb5e17961: start","job_status":"start","queue_duration_s":0.816331,"scheduling_latency_s":0.816347} gitlab # [ 149.078762] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6b78e8665e1ce4eb5e17961","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6b78e8665e1ce4eb5e17961: done: 0.010519 sec","job_status":"done","queue_duration_s":0.816331,"scheduling_latency_s":0.816347,"redis_calls":13,"redis_duration_s":0.001756,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010519,"completed_at":"2026-08-20T08:18:26.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.089490] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"845dc53372700dae2a287f98","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-845dc53372700dae2a287f98: start","job_status":"start","queue_duration_s":0.827996,"scheduling_latency_s":0.828011} gitlab # [ 149.132860] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"845dc53372700dae2a287f98","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-845dc53372700dae2a287f98: done: 0.010576 sec","job_status":"done","queue_duration_s":0.827996,"scheduling_latency_s":0.828011,"redis_calls":13,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010576,"completed_at":"2026-08-20T08:18:26.310Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.133848] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3af7c9e3037c044315ef2335","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3af7c9e3037c044315ef2335: start","job_status":"start","queue_duration_s":0.839651,"scheduling_latency_s":0.839668} gitlab # [ 149.140483] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3af7c9e3037c044315ef2335","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3af7c9e3037c044315ef2335: done: 0.010713 sec","job_status":"done","queue_duration_s":0.839651,"scheduling_latency_s":0.839668,"redis_calls":13,"redis_duration_s":0.001748,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010713,"completed_at":"2026-08-20T08:18:26.322Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.182041] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d8c2fcba5750c11b9f96dd4","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d8c2fcba5750c11b9f96dd4: start","job_status":"start","queue_duration_s":0.851498,"scheduling_latency_s":0.851513} gitlab # [ 149.182681] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d8c2fcba5750c11b9f96dd4","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d8c2fcba5750c11b9f96dd4: done: 0.010795 sec","job_status":"done","queue_duration_s":0.851498,"scheduling_latency_s":0.851513,"redis_calls":13,"redis_duration_s":0.0018549999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010795,"completed_at":"2026-08-20T08:18:26.334Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.233673] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7547b1052a5c613835d42b9e","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7547b1052a5c613835d42b9e: start","job_status":"start","queue_duration_s":0.863411,"scheduling_latency_s":0.863427} gitlab # [ 149.234069] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7547b1052a5c613835d42b9e","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7547b1052a5c613835d42b9e: done: 0.01063 sec","job_status":"done","queue_duration_s":0.863411,"scheduling_latency_s":0.863427,"redis_calls":13,"redis_duration_s":0.001786,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001216,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01063,"completed_at":"2026-08-20T08:18:26.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.282606] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61345f2f92497b587aeaddd4","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61345f2f92497b587aeaddd4: start","job_status":"start","queue_duration_s":0.874953,"scheduling_latency_s":0.874967} gitlab # [ 149.283454] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61345f2f92497b587aeaddd4","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61345f2f92497b587aeaddd4: done: 0.010723 sec","job_status":"done","queue_duration_s":0.874953,"scheduling_latency_s":0.874967,"redis_calls":13,"redis_duration_s":0.001934,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001342,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010723,"completed_at":"2026-08-20T08:18:26.357Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.319125] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49b439dd445c51ca460180ba","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49b439dd445c51ca460180ba: start","job_status":"start","queue_duration_s":0.886612,"scheduling_latency_s":0.886627} gitlab # [ 149.319794] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49b439dd445c51ca460180ba","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49b439dd445c51ca460180ba: done: 0.010996 sec","job_status":"done","queue_duration_s":0.886612,"scheduling_latency_s":0.886627,"redis_calls":13,"redis_duration_s":0.001798,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001215,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010996,"completed_at":"2026-08-20T08:18:26.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.369466] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0da6e8204a0c699a590d14f","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0da6e8204a0c699a590d14f: start","job_status":"start","queue_duration_s":0.898526,"scheduling_latency_s":0.89854} gitlab # [ 149.370219] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0da6e8204a0c699a590d14f","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0da6e8204a0c699a590d14f: done: 0.010652 sec","job_status":"done","queue_duration_s":0.898526,"scheduling_latency_s":0.89854,"redis_calls":13,"redis_duration_s":0.002052,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001322,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010652,"completed_at":"2026-08-20T08:18:26.380Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.406056] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3025a12f59c291c900d3b7b","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3025a12f59c291c900d3b7b: start","job_status":"start","queue_duration_s":0.910112,"scheduling_latency_s":0.910127} gitlab # [ 149.406717] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3025a12f59c291c900d3b7b","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3025a12f59c291c900d3b7b: done: 0.011117 sec","job_status":"done","queue_duration_s":0.910112,"scheduling_latency_s":0.910127,"redis_calls":13,"redis_duration_s":0.0020039999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011117,"completed_at":"2026-08-20T08:18:26.393Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.444737] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8886856dec9167afdfb7fc89","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8886856dec9167afdfb7fc89: start","job_status":"start","queue_duration_s":0.922231,"scheduling_latency_s":0.922255} gitlab # [ 149.445080] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8886856dec9167afdfb7fc89","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8886856dec9167afdfb7fc89: done: 0.011066 sec","job_status":"done","queue_duration_s":0.922231,"scheduling_latency_s":0.922255,"redis_calls":13,"redis_duration_s":0.001685,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001144,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011066,"completed_at":"2026-08-20T08:18:26.405Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.485574] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c21f6c8f927ed4187f609dd3","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c21f6c8f927ed4187f609dd3: start","job_status":"start","queue_duration_s":0.934512,"scheduling_latency_s":0.934528} gitlab # [ 149.486406] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c21f6c8f927ed4187f609dd3","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c21f6c8f927ed4187f609dd3: done: 0.01058 sec","job_status":"done","queue_duration_s":0.934512,"scheduling_latency_s":0.934528,"redis_calls":13,"redis_duration_s":0.00179,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01058,"completed_at":"2026-08-20T08:18:26.416Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.523247] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d312fcf1aeb127de491d5fd2","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d312fcf1aeb127de491d5fd2: start","job_status":"start","queue_duration_s":0.946162,"scheduling_latency_s":0.946177} gitlab # [ 149.523842] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d312fcf1aeb127de491d5fd2","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d312fcf1aeb127de491d5fd2: done: 0.010848 sec","job_status":"done","queue_duration_s":0.946162,"scheduling_latency_s":0.946177,"redis_calls":13,"redis_duration_s":0.001888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001319,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010848,"completed_at":"2026-08-20T08:18:26.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.560549] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0cfe4b29c9b9207885366006","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0cfe4b29c9b9207885366006: start","job_status":"start","queue_duration_s":0.958098,"scheduling_latency_s":0.958113} gitlab # [ 149.561455] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0cfe4b29c9b9207885366006","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0cfe4b29c9b9207885366006: done: 0.010404 sec","job_status":"done","queue_duration_s":0.958098,"scheduling_latency_s":0.958113,"redis_calls":13,"redis_duration_s":0.001755,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010404,"completed_at":"2026-08-20T08:18:26.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.581975] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82b5a5d0e73bd21cf83b6cda","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82b5a5d0e73bd21cf83b6cda: start","job_status":"start","queue_duration_s":0.969577,"scheduling_latency_s":0.969591} gitlab # [ 149.617115] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82b5a5d0e73bd21cf83b6cda","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82b5a5d0e73bd21cf83b6cda: done: 0.010892 sec","job_status":"done","queue_duration_s":0.969577,"scheduling_latency_s":0.969591,"redis_calls":13,"redis_duration_s":0.001785,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010892,"completed_at":"2026-08-20T08:18:26.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.623663] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d0a0c95e683a64054b5a4f2","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d0a0c95e683a64054b5a4f2: start","job_status":"start","queue_duration_s":0.981559,"scheduling_latency_s":0.981573} gitlab # [ 149.667258] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d0a0c95e683a64054b5a4f2","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d0a0c95e683a64054b5a4f2: done: 0.010525 sec","job_status":"done","queue_duration_s":0.981559,"scheduling_latency_s":0.981573,"redis_calls":13,"redis_duration_s":0.0018210000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010525,"completed_at":"2026-08-20T08:18:26.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.668481] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb9f6faff6c908c353114a15","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb9f6faff6c908c353114a15: start","job_status":"start","queue_duration_s":0.993186,"scheduling_latency_s":0.993202} gitlab # [ 149.674751] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb9f6faff6c908c353114a15","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb9f6faff6c908c353114a15: done: 0.010387 sec","job_status":"done","queue_duration_s":0.993186,"scheduling_latency_s":0.993202,"redis_calls":13,"redis_duration_s":0.001715,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001175,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010387,"completed_at":"2026-08-20T08:18:26.475Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.736515] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0b5bf5ab282719dd89e5795","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0b5bf5ab282719dd89e5795: start","job_status":"start","queue_duration_s":1.004478,"scheduling_latency_s":1.004494} gitlab # [ 149.737189] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0b5bf5ab282719dd89e5795","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0b5bf5ab282719dd89e5795: done: 0.011133 sec","job_status":"done","queue_duration_s":1.004478,"scheduling_latency_s":1.004494,"redis_calls":13,"redis_duration_s":0.002104,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001164,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011133,"completed_at":"2026-08-20T08:18:26.487Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.747892] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60df67dc815c4353362dae55","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60df67dc815c4353362dae55: start","job_status":"start","queue_duration_s":1.016554,"scheduling_latency_s":1.016569} gitlab # [ 149.758081] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60df67dc815c4353362dae55","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60df67dc815c4353362dae55: done: 0.010611 sec","job_status":"done","queue_duration_s":1.016554,"scheduling_latency_s":1.016569,"redis_calls":13,"redis_duration_s":0.001703,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010611,"completed_at":"2026-08-20T08:18:26.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.790611] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58ca2afd13d2eae57baa4ca6","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58ca2afd13d2eae57baa4ca6: start","job_status":"start","queue_duration_s":1.02812,"scheduling_latency_s":1.028136} gitlab # [ 149.800922] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58ca2afd13d2eae57baa4ca6","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58ca2afd13d2eae57baa4ca6: done: 0.01062 sec","job_status":"done","queue_duration_s":1.02812,"scheduling_latency_s":1.028136,"redis_calls":13,"redis_duration_s":0.001769,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001194,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01062,"completed_at":"2026-08-20T08:18:26.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.837959] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abfbe83a23b48015da290754","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abfbe83a23b48015da290754: start","job_status":"start","queue_duration_s":1.039674,"scheduling_latency_s":1.039689} gitlab # [ 149.841954] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abfbe83a23b48015da290754","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abfbe83a23b48015da290754: done: 0.010652 sec","job_status":"done","queue_duration_s":1.039674,"scheduling_latency_s":1.039689,"redis_calls":13,"redis_duration_s":0.0018020000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001211,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010652,"completed_at":"2026-08-20T08:18:26.522Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.890631] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bf66b0ee79e041434113211","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bf66b0ee79e041434113211: start","job_status":"start","queue_duration_s":1.051429,"scheduling_latency_s":1.051444} gitlab # [ 149.891470] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bf66b0ee79e041434113211","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bf66b0ee79e041434113211: done: 0.010518 sec","job_status":"done","queue_duration_s":1.051429,"scheduling_latency_s":1.051444,"redis_calls":13,"redis_duration_s":0.0017629999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010518,"completed_at":"2026-08-20T08:18:26.533Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.943638] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c23a0896183383759b2a6aaf","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c23a0896183383759b2a6aaf: start","job_status":"start","queue_duration_s":1.063064,"scheduling_latency_s":1.06308} gitlab # [ 149.944486] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c23a0896183383759b2a6aaf","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c23a0896183383759b2a6aaf: done: 0.010407 sec","job_status":"done","queue_duration_s":1.063064,"scheduling_latency_s":1.06308,"redis_calls":13,"redis_duration_s":0.001647,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010407,"completed_at":"2026-08-20T08:18:26.545Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 149.982068] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0d408f0a0c969111203a008","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0d408f0a0c969111203a008: start","job_status":"start","queue_duration_s":1.07456,"scheduling_latency_s":1.074575} gitlab # [ 149.982749] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0d408f0a0c969111203a008","created_at":"2026-08-20T08:18:25.250Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-b99756210b904735","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f734ca423e72c4de36d7fe56be036df2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.471Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0d408f0a0c969111203a008: done: 0.010613 sec","job_status":"done","queue_duration_s":1.07456,"scheduling_latency_s":1.074575,"redis_calls":13,"redis_duration_s":0.001755,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001152,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010613,"completed_at":"2026-08-20T08:18:26.556Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.025755] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.558Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3d53edf1599421630cf97faa","created_at":"2026-08-20T08:18:25.488Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6e6cbd59d92574327ae2d9b5303a194","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.543Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3d53edf1599421630cf97faa: start","job_status":"start","queue_duration_s":1.014896,"scheduling_latency_s":1.014911} gitlab # [ 150.026653] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3d53edf1599421630cf97faa","created_at":"2026-08-20T08:18:25.488Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6e6cbd59d92574327ae2d9b5303a194","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.543Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3d53edf1599421630cf97faa: done: 0.024196 sec","job_status":"done","queue_duration_s":1.014896,"scheduling_latency_s":1.014911,"redis_calls":10,"redis_duration_s":0.001437,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000317,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000275734,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.024196,"completed_at":"2026-08-20T08:18:26.582Z","load_balancing_strategy":"primary","db_duration_s":0.007402,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.069211] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"20d647ea9683a382d2ec64e0","created_at":"2026-08-20T08:18:25.571Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06a3a688cf4313a2292ec7eb8f215bd3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.587Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-20d647ea9683a382d2ec64e0: start","job_status":"start","queue_duration_s":0.995839,"scheduling_latency_s":0.995856} gitlab # [ 150.069864] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.756Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"20d647ea9683a382d2ec64e0","created_at":"2026-08-20T08:18:25.571Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06a3a688cf4313a2292ec7eb8f215bd3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.587Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-20d647ea9683a382d2ec64e0: done: 0.172664 sec","job_status":"done","queue_duration_s":0.995839,"scheduling_latency_s":0.995856,"redis_calls":14,"redis_duration_s":0.0023639999999999998,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000541,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000852,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.124263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000353956,"exclusive_lock_hold_duration_s":0.154597582,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.172664,"completed_at":"2026-08-20T08:18:26.756Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0509,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.107026] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.757Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1cfdf973e56588db7a2a3ff2","created_at":"2026-08-20T08:18:25.603Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc1c4112cc4a45859a7a0deeb4d4a826","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.615Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1cfdf973e56588db7a2a3ff2: start","job_status":"start","queue_duration_s":1.142398,"scheduling_latency_s":1.142417} gitlab # [ 150.107743] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.789Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1cfdf973e56588db7a2a3ff2","created_at":"2026-08-20T08:18:25.603Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc1c4112cc4a45859a7a0deeb4d4a826","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.615Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1cfdf973e56588db7a2a3ff2: done: 0.031111 sec","job_status":"done","queue_duration_s":1.142398,"scheduling_latency_s":1.142417,"redis_calls":14,"redis_duration_s":0.002151,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00057,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000687,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000374628,"exclusive_lock_hold_duration_s":0.014626160000000001,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.031111,"completed_at":"2026-08-20T08:18:26.788Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008224,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.156070] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:26.790Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"cf7632a0d3a06a75456f42ad","created_at":"2026-08-20T08:18:25.626Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7029c9a221da9b6c7fb12941f451e1d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.675Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-cf7632a0d3a06a75456f42ad: start","job_status":"start","queue_duration_s":1.114909,"scheduling_latency_s":1.114924} gitlab # [ 150.156683] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.126Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"cf7632a0d3a06a75456f42ad","created_at":"2026-08-20T08:18:25.626Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7029c9a221da9b6c7fb12941f451e1d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.675Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-cf7632a0d3a06a75456f42ad: done: 0.336172 sec","job_status":"done","queue_duration_s":1.114909,"scheduling_latency_s":1.114924,"redis_calls":565,"redis_duration_s":0.06997400000000001,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.068775,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.252554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000267073,"duration_s":0.336172,"completed_at":"2026-08-20T08:18:27.126Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000359,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.201812] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"77e15d04cfe1ca5c89002995","created_at":"2026-08-20T08:18:25.704Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19e6c1f4ba3b2e9a6cc37b598552cd5a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.716Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-77e15d04cfe1ca5c89002995: start","job_status":"start","queue_duration_s":1.41104,"scheduling_latency_s":1.411059} gitlab # [ 150.202678] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.160Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"77e15d04cfe1ca5c89002995","created_at":"2026-08-20T08:18:25.704Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19e6c1f4ba3b2e9a6cc37b598552cd5a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.716Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-77e15d04cfe1ca5c89002995: done: 0.032918 sec","job_status":"done","queue_duration_s":1.41104,"scheduling_latency_s":1.411059,"redis_calls":12,"redis_duration_s":0.0018440000000000002,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000295,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00072,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000429943,"exclusive_lock_hold_duration_s":0.009827785,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.032918,"completed_at":"2026-08-20T08:18:27.160Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.247103] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.161Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"637bf1e33a50634603b5f7da","created_at":"2026-08-20T08:18:25.948Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-4442f125e5a34d1f","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b64e46fcdefbc7867477ed5f22f478dd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.956Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-637bf1e33a50634603b5f7da: start","job_status":"start","queue_duration_s":1.205512,"scheduling_latency_s":1.205527} gitlab # [ 150.247756] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.172Z","message":"No existing merge request to be cleaned up."} gitlab # [ 150.248489] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.180Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"637bf1e33a50634603b5f7da","created_at":"2026-08-20T08:18:25.948Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-4442f125e5a34d1f","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b64e46fcdefbc7867477ed5f22f478dd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.956Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-637bf1e33a50634603b5f7da: done: 0.019031 sec","job_status":"done","queue_duration_s":1.205512,"scheduling_latency_s":1.205527,"redis_calls":13,"redis_duration_s":0.001903,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000306,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000230476,"duration_s":0.019031,"completed_at":"2026-08-20T08:18:27.180Z","load_balancing_strategy":"primary","db_duration_s":0.002249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.302987] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.181Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5bf89da4a07541602f447c36","created_at":"2026-08-20T08:18:25.948Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-4442f125e5a34d1f","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b64e46fcdefbc7867477ed5f22f478dd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.956Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5bf89da4a07541602f447c36: start","job_status":"start","queue_duration_s":1.225488,"scheduling_latency_s":1.225503} gitlab # [ 150.303662] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.189Z","message":"No existing merge request to be cleaned up."} gitlab # [ 150.303996] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.197Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5bf89da4a07541602f447c36","created_at":"2026-08-20T08:18:25.948Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-4442f125e5a34d1f","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b64e46fcdefbc7867477ed5f22f478dd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.956Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5bf89da4a07541602f447c36: done: 0.015412 sec","job_status":"done","queue_duration_s":1.225488,"scheduling_latency_s":1.225503,"redis_calls":10,"redis_duration_s":0.00413,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003277,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015412,"completed_at":"2026-08-20T08:18:27.197Z","load_balancing_strategy":"primary","db_duration_s":0.001093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.346800] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.198Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"406bb843cde5755fc7deb43f","created_at":"2026-08-20T08:18:25.948Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-4442f125e5a34d1f","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b64e46fcdefbc7867477ed5f22f478dd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.956Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-406bb843cde5755fc7deb43f: start","job_status":"start","queue_duration_s":1.241893,"scheduling_latency_s":1.241908} gitlab # [ 150.347559] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.207Z","message":"No existing merge request to be cleaned up."} gitlab # [ 150.348130] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.213Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"406bb843cde5755fc7deb43f","created_at":"2026-08-20T08:18:25.948Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-4442f125e5a34d1f","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b64e46fcdefbc7867477ed5f22f478dd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.956Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-406bb843cde5755fc7deb43f: done: 0.015333 sec","job_status":"done","queue_duration_s":1.241893,"scheduling_latency_s":1.241908,"redis_calls":10,"redis_duration_s":0.001521,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015333,"completed_at":"2026-08-20T08:18:27.213Z","load_balancing_strategy":"primary","db_duration_s":0.004891,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.356114] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.214Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"01babf6c9733d3041b443f8c","created_at":"2026-08-20T08:18:25.948Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-4442f125e5a34d1f","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b64e46fcdefbc7867477ed5f22f478dd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.956Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-01babf6c9733d3041b443f8c: start","job_status":"start","queue_duration_s":1.258191,"scheduling_latency_s":1.258208} gitlab # [ 150.366428] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.221Z","message":"No existing merge request to be cleaned up."} gitlab # [ 150.367624] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:27.226Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"01babf6c9733d3041b443f8c","created_at":"2026-08-20T08:18:25.948Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-4442f125e5a34d1f","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b64e46fcdefbc7867477ed5f22f478dd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:18:25.956Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-01babf6c9733d3041b443f8c: done: 0.011974 sec","job_status":"done","queue_duration_s":1.258191,"scheduling_latency_s":1.258208,"redis_calls":10,"redis_duration_s":0.001421,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000857,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011974,"completed_at":"2026-08-20T08:18:27.226Z","load_balancing_strategy":"primary","db_duration_s":0.001128,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.571459] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2163420915 wd_nsec: 2163420848 gitlab # [ 150.441914] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:28.749Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"29512638ea7ef1331664c850","created_at":"2026-08-20T08:18:25.736Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46b9b0c23e7dc13309ab1e2650bd5d6d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:18:28.747Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-29512638ea7ef1331664c850: start","job_status":"start","queue_duration_s":0.001898,"scheduling_latency_s":0.001945} gitlab # [ 150.458307] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:28.765Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 150.467860] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:28.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"29512638ea7ef1331664c850","created_at":"2026-08-20T08:18:25.736Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46b9b0c23e7dc13309ab1e2650bd5d6d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:18:28.747Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-29512638ea7ef1331664c850: done: 0.026092 sec","job_status":"done","queue_duration_s":0.001898,"scheduling_latency_s":0.001945,"redis_calls":10,"redis_duration_s":0.004688,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001333,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003033,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000622704,"duration_s":0.026092,"completed_at":"2026-08-20T08:18:28.775Z","load_balancing_strategy":"primary","db_duration_s":0.002357,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.488205] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:28.778Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3773b29dd93855a6c5ec7502","created_at":"2026-08-20T08:18:28.764Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc0231cd1b140b317ada656237c9c1b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:28.777Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3773b29dd93855a6c5ec7502: start","job_status":"start","queue_duration_s":0.001281,"scheduling_latency_s":0.001299} gitlab # [ 150.525128] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:28.830Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 150.552546] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:28.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3773b29dd93855a6c5ec7502","created_at":"2026-08-20T08:18:28.764Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc0231cd1b140b317ada656237c9c1b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:28.777Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3773b29dd93855a6c5ec7502: done: 0.080646 sec","job_status":"done","queue_duration_s":0.001281,"scheduling_latency_s":0.001299,"redis_calls":10,"redis_duration_s":0.009393,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001951,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006358,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003268852,"duration_s":0.080646,"completed_at":"2026-08-20T08:18:28.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.038189,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.572569] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:28.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d01c5235cb71d69000e591ec","created_at":"2026-08-20T08:18:28.821Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ebf40153f015acd036bdce22b7946f44","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:18:28.840Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d01c5235cb71d69000e591ec: start","job_status":"start","queue_duration_s":0.026653,"scheduling_latency_s":0.026702} gitlab # [ 150.620103] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:28.927Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 150.637178] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:28.944Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d01c5235cb71d69000e591ec","created_at":"2026-08-20T08:18:28.821Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ebf40153f015acd036bdce22b7946f44","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:18:28.840Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d01c5235cb71d69000e591ec: done: 0.077028 sec","job_status":"done","queue_duration_s":0.026653,"scheduling_latency_s":0.026702,"redis_calls":10,"redis_duration_s":0.034522,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00204,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.024553,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00091073,"duration_s":0.077028,"completed_at":"2026-08-20T08:18:28.944Z","load_balancing_strategy":"primary","db_duration_s":0.003225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.676357] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:28.983Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4f9aefb3659ec9a2eb98af42","created_at":"2026-08-20T08:18:28.860Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85df1e3a63c647fcb8b79e7eb7d3ce30","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:28.874Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4f9aefb3659ec9a2eb98af42: start","job_status":"start","queue_duration_s":0.108617,"scheduling_latency_s":0.108648} gitlab # [ 150.746423] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:29.052Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4f9aefb3659ec9a2eb98af42","created_at":"2026-08-20T08:18:28.860Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85df1e3a63c647fcb8b79e7eb7d3ce30","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:28.874Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4f9aefb3659ec9a2eb98af42: done: 0.069183 sec","job_status":"done","queue_duration_s":0.108617,"scheduling_latency_s":0.108648,"redis_calls":13,"redis_duration_s":0.011053,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000874,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.008419,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00176,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.012590427,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.069183,"completed_at":"2026-08-20T08:18:29.052Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004378,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 150.748504] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:29.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2cc3d57c34724891be0b5ec7","created_at":"2026-08-20T08:18:28.917Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92042b158c444bfe831b37813a0fbd97","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:28.933Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2cc3d57c34724891be0b5ec7: start","job_status":"start","queue_duration_s":0.120996,"scheduling_latency_s":0.121022} gitlab # [ 150.789692] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:29.066Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 150.790492] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:29.071Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2cc3d57c34724891be0b5ec7","created_at":"2026-08-20T08:18:28.917Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92042b158c444bfe831b37813a0fbd97","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:28.933Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2cc3d57c34724891be0b5ec7: done: 0.017067 sec","job_status":"done","queue_duration_s":0.120996,"scheduling_latency_s":0.121022,"redis_calls":10,"redis_duration_s":0.002502,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000497,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001484,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000300318,"duration_s":0.017067,"completed_at":"2026-08-20T08:18:29.071Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000613,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.803368] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:29.072Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"2a34ba405a0aca16570f927c","created_at":"2026-08-20T08:18:28.979Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ba380fe5765b2229cff8079b820b9ea","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:29.000Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-2a34ba405a0aca16570f927c: start","job_status":"start","queue_duration_s":0.071682,"scheduling_latency_s":0.071695} gitlab # [ 150.815594] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:18:29.087Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"2a34ba405a0aca16570f927c","created_at":"2026-08-20T08:18:28.979Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ba380fe5765b2229cff8079b820b9ea","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:29.000Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-2a34ba405a0aca16570f927c: done: 0.014726 sec","job_status":"done","queue_duration_s":0.071682,"scheduling_latency_s":0.071695,"redis_calls":12,"redis_duration_s":0.002899,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000629,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000524,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001264,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000286908,"duration_s":0.014726,"completed_at":"2026-08-20T08:18:29.087Z","load_balancing_strategy":"primary","db_duration_s":0.000547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.505365] setup-gitlab-start[2259]: W, [2026-08-20T08:18:42.811869 #2259] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 186.785777] postgres[2459]: [2459] ERROR: relation "table_without_models" does not exist gitlab # [ 186.787505] postgres[2459]: [2459] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 188.499141] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:06.805Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f8ba33908548d303234ceb3a","created_at":"2026-08-20T08:19:06.752Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c356d0b63cf2a19e65ff89792bfb1413","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:06.801Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f8ba33908548d303234ceb3a: start","job_status":"start","queue_duration_s":0.003244,"scheduling_latency_s":0.003306} gitlab # [ 188.575536] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:06.882Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f8ba33908548d303234ceb3a","created_at":"2026-08-20T08:19:06.752Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c356d0b63cf2a19e65ff89792bfb1413","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:06.801Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f8ba33908548d303234ceb3a: done: 0.077122 sec","job_status":"done","queue_duration_s":0.003244,"scheduling_latency_s":0.003306,"redis_calls":8,"redis_duration_s":0.00783,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00093,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.077122,"completed_at":"2026-08-20T08:19:06.882Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 188.619106] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:06.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a36d2678d2d7ccb3dc3b41e6","created_at":"2026-08-20T08:19:06.844Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:06.847Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a36d2678d2d7ccb3dc3b41e6: start","job_status":"start","queue_duration_s":0.073248,"scheduling_latency_s":0.073293} gitlab # [ 188.984645] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.290Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a36d2678d2d7ccb3dc3b41e6","created_at":"2026-08-20T08:19:06.844Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:06.847Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a36d2678d2d7ccb3dc3b41e6: done: 0.370003 sec","job_status":"done","queue_duration_s":0.073248,"scheduling_latency_s":0.073293,"redis_calls":60,"redis_duration_s":0.10878600000000001,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.00276,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.092603,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.013423,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.124004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.370003,"completed_at":"2026-08-20T08:19:07.290Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 189.053187] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.359Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9bee067888a62f65fa23efe2","created_at":"2026-08-20T08:19:06.865Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"152a0bf9f39894f8de717afdee97b6da","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:06.873Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9bee067888a62f65fa23efe2: start","job_status":"start","queue_duration_s":0.485898,"scheduling_latency_s":0.48594} gitlab # [ 189.134329] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.440Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9bee067888a62f65fa23efe2","created_at":"2026-08-20T08:19:06.865Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"152a0bf9f39894f8de717afdee97b6da","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:06.873Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9bee067888a62f65fa23efe2: done: 0.081058 sec","job_status":"done","queue_duration_s":0.485898,"scheduling_latency_s":0.48594,"redis_calls":10,"redis_duration_s":0.010411,"redis_read_bytes":135,"redis_write_bytes":1136,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001723,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006077,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002611,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001593778,"exclusive_lock_hold_duration_s":0.035588602,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.081058,"completed_at":"2026-08-20T08:19:07.440Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 189.181935] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.488Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e411108b832656f4e1363785","created_at":"2026-08-20T08:19:06.917Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f442dcdae67a998f9b76926b98cc6df","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:06.919Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e411108b832656f4e1363785: start","job_status":"start","queue_duration_s":0.569153,"scheduling_latency_s":0.569197} gitlab # [ 189.216175] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.523Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e411108b832656f4e1363785","created_at":"2026-08-20T08:19:06.917Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f442dcdae67a998f9b76926b98cc6df","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:06.919Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e411108b832656f4e1363785: done: 0.034254 sec","job_status":"done","queue_duration_s":0.569153,"scheduling_latency_s":0.569197,"redis_calls":9,"redis_duration_s":0.002306,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001379,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01563,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000628851,"exclusive_lock_hold_duration_s":0.005184178,"duration_s":0.034254,"completed_at":"2026-08-20T08:19:07.522Z","load_balancing_strategy":"primary","db_duration_s":0.002147,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 189.250229] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.556Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"4ca08fee828ad0b601b53892","created_at":"2026-08-20T08:19:06.972Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5137ab5d35466e66f842ff9764820177","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:06.978Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-4ca08fee828ad0b601b53892: start","job_status":"start","queue_duration_s":0.578808,"scheduling_latency_s":0.578847} gitlab # [ 189.271688] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.578Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 189.281074] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.587Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"4ca08fee828ad0b601b53892","created_at":"2026-08-20T08:19:06.972Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5137ab5d35466e66f842ff9764820177","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:06.978Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-4ca08fee828ad0b601b53892: done: 0.030938 sec","job_status":"done","queue_duration_s":0.578808,"scheduling_latency_s":0.578847,"redis_calls":7,"redis_duration_s":0.003405,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002941,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030938,"completed_at":"2026-08-20T08:19:07.587Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 189.314836] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.621Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"fd97cc1a74909cd11b11bf1f","created_at":"2026-08-20T08:19:06.995Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95502d3da801739833165216936edc8d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.001Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-fd97cc1a74909cd11b11bf1f: start","job_status":"start","queue_duration_s":0.620732,"scheduling_latency_s":0.620773} gitlab # [ 189.344454] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.651Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"fd97cc1a74909cd11b11bf1f","created_at":"2026-08-20T08:19:06.995Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95502d3da801739833165216936edc8d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.001Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-fd97cc1a74909cd11b11bf1f: done: 0.029415 sec","job_status":"done","queue_duration_s":0.620732,"scheduling_latency_s":0.620773,"redis_calls":7,"redis_duration_s":0.001712,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029415,"completed_at":"2026-08-20T08:19:07.651Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 189.378411] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.685Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2b3b232a81d66d1bd0368a09","created_at":"2026-08-20T08:19:07.014Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65c9a2567cc615c7062b600b17950e44","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.019Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2b3b232a81d66d1bd0368a09: start","job_status":"start","queue_duration_s":0.66605,"scheduling_latency_s":0.66609} gitlab # [ 189.411458] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2b3b232a81d66d1bd0368a09","created_at":"2026-08-20T08:19:07.014Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65c9a2567cc615c7062b600b17950e44","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.019Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2b3b232a81d66d1bd0368a09: done: 0.033053 sec","job_status":"done","queue_duration_s":0.66605,"scheduling_latency_s":0.66609,"redis_calls":7,"redis_duration_s":0.002457,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001662,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000795,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033053,"completed_at":"2026-08-20T08:19:07.718Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 189.445996] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.753Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0545be2194844285a898b82d","created_at":"2026-08-20T08:19:07.032Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7aae34a8061bfa7a81b30bb7e47f5f06","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.036Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0545be2194844285a898b82d: start","job_status":"start","queue_duration_s":0.71661,"scheduling_latency_s":0.716652} gitlab # [ 189.484776] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.790Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0545be2194844285a898b82d","created_at":"2026-08-20T08:19:07.032Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7aae34a8061bfa7a81b30bb7e47f5f06","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.036Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0545be2194844285a898b82d: done: 0.03792 sec","job_status":"done","queue_duration_s":0.71661,"scheduling_latency_s":0.716652,"redis_calls":7,"redis_duration_s":0.0022199999999999998,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001622,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000598,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03792,"completed_at":"2026-08-20T08:19:07.790Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014198,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 189.486910] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d785294b934bb08c4b0ab037","created_at":"2026-08-20T08:19:07.045Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c81c2cc4c1c8377a3209bc478522c846","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.049Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d785294b934bb08c4b0ab037: start","job_status":"start","queue_duration_s":0.744073,"scheduling_latency_s":0.744106} gitlab # [ 189.497782] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.805Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 189.505076] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d785294b934bb08c4b0ab037","created_at":"2026-08-20T08:19:07.045Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c81c2cc4c1c8377a3209bc478522c846","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.049Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d785294b934bb08c4b0ab037: done: 0.017333 sec","job_status":"done","queue_duration_s":0.744073,"scheduling_latency_s":0.744106,"redis_calls":7,"redis_duration_s":0.002101,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001579,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000522,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017333,"completed_at":"2026-08-20T08:19:07.811Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 189.531177] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ee799fd2b568fca4f2770a73","created_at":"2026-08-20T08:19:07.063Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa7f47c1a3c2f7c5e7908dcefd90b125","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:19:07.065Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ee799fd2b568fca4f2770a73: start","job_status":"start","queue_duration_s":0.747587,"scheduling_latency_s":0.747611} gitlab # [ 189.572292] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.834Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ee799fd2b568fca4f2770a73","created_at":"2026-08-20T08:19:07.063Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa7f47c1a3c2f7c5e7908dcefd90b125","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:19:07.065Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ee799fd2b568fca4f2770a73: done: 0.021237 sec","job_status":"done","queue_duration_s":0.747587,"scheduling_latency_s":0.747611,"redis_calls":7,"redis_duration_s":0.0014980000000000002,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021237,"completed_at":"2026-08-20T08:19:07.834Z","load_balancing_strategy":"primary","db_duration_s":0.004147,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 189.573483] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.835Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"437f9fd4c23adf81ad09db06","created_at":"2026-08-20T08:19:07.092Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a41e45ff1ff15a5e6a5f4ad56706074","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.097Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-437f9fd4c23adf81ad09db06: start","job_status":"start","queue_duration_s":0.737679,"scheduling_latency_s":0.737695} gitlab # [ 189.584650] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.851Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"437f9fd4c23adf81ad09db06","created_at":"2026-08-20T08:19:07.092Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a41e45ff1ff15a5e6a5f4ad56706074","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.097Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-437f9fd4c23adf81ad09db06: done: 0.016014 sec","job_status":"done","queue_duration_s":0.737679,"scheduling_latency_s":0.737695,"redis_calls":14,"redis_duration_s":0.0018499999999999999,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000203,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001236,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000411,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016014,"completed_at":"2026-08-20T08:19:07.851Z","load_balancing_strategy":"primary","db_duration_s":0.001455,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 189.628924] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"770fd75c80ad0f1f672ec857","created_at":"2026-08-20T08:19:07.148Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca661a1dc426be2b93305473c76379fa","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.153Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-770fd75c80ad0f1f672ec857: start","job_status":"start","queue_duration_s":0.699215,"scheduling_latency_s":0.699228} gitlab # [ 189.629606] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"770fd75c80ad0f1f672ec857","created_at":"2026-08-20T08:19:07.148Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca661a1dc426be2b93305473c76379fa","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.153Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-770fd75c80ad0f1f672ec857: done: 0.013948 sec","job_status":"done","queue_duration_s":0.699215,"scheduling_latency_s":0.699228,"redis_calls":7,"redis_duration_s":0.000908,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.013948,"completed_at":"2026-08-20T08:19:07.866Z","load_balancing_strategy":"primary","db_duration_s":0.004889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 189.661745] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:07.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"45f2e448fbb38d0c1ac5715a","created_at":"2026-08-20T08:19:07.169Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b5d73ef5aea6b04d24e51705f7fa06f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.172Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-45f2e448fbb38d0c1ac5715a: start","job_status":"start","queue_duration_s":0.69426,"scheduling_latency_s":0.694275} gitlab # [ 189.714556] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.021Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"45f2e448fbb38d0c1ac5715a","created_at":"2026-08-20T08:19:07.169Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b5d73ef5aea6b04d24e51705f7fa06f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.172Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-45f2e448fbb38d0c1ac5715a: done: 0.154488 sec","job_status":"done","queue_duration_s":0.69426,"scheduling_latency_s":0.694275,"redis_calls":9,"redis_duration_s":0.001358,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00066,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000305346,"exclusive_lock_hold_duration_s":0.144729008,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.154488,"completed_at":"2026-08-20T08:19:08.021Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.053752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 189.715604] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.022Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"782d7952cf32a59951136859","created_at":"2026-08-20T08:19:07.181Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52109af9c598b34e69508e668536aabc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.184Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-782d7952cf32a59951136859: start","job_status":"start","queue_duration_s":0.838587,"scheduling_latency_s":0.838603} gitlab # [ 189.784723] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.091Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"782d7952cf32a59951136859","created_at":"2026-08-20T08:19:07.181Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52109af9c598b34e69508e668536aabc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.184Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-782d7952cf32a59951136859: done: 0.068518 sec","job_status":"done","queue_duration_s":0.838587,"scheduling_latency_s":0.838603,"redis_calls":9,"redis_duration_s":0.0016879999999999998,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000824,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000330769,"exclusive_lock_hold_duration_s":0.054890217,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.068518,"completed_at":"2026-08-20T08:19:08.091Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 189.804109] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.093Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4df60f2ea93973ac5f600c10","created_at":"2026-08-20T08:19:07.192Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37a4183805ad00fffe17b62d01c2c894","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.196Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4df60f2ea93973ac5f600c10: start","job_status":"start","queue_duration_s":0.896391,"scheduling_latency_s":0.896417} gitlab # [ 190.079930] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4df60f2ea93973ac5f600c10","created_at":"2026-08-20T08:19:07.192Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37a4183805ad00fffe17b62d01c2c894","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.196Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4df60f2ea93973ac5f600c10: done: 0.293516 sec","job_status":"done","queue_duration_s":0.896391,"scheduling_latency_s":0.896417,"redis_calls":562,"redis_duration_s":0.110251,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001058,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.109193,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.212951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.293516,"completed_at":"2026-08-20T08:19:08.386Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.116166] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.420Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"3b62889ff98e8a02d34a8162","created_at":"2026-08-20T08:19:07.225Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d28757b12839696a08514208b1607a1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.231Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-3b62889ff98e8a02d34a8162: start","job_status":"start","queue_duration_s":1.189434,"scheduling_latency_s":1.189468} gitlab # [ 190.169665] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.476Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"3b62889ff98e8a02d34a8162","created_at":"2026-08-20T08:19:07.225Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d28757b12839696a08514208b1607a1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.231Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-3b62889ff98e8a02d34a8162: done: 0.055615 sec","job_status":"done","queue_duration_s":1.189434,"scheduling_latency_s":1.189468,"redis_calls":9,"redis_duration_s":0.002666,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001406,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001030298,"exclusive_lock_hold_duration_s":0.017092396,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.055615,"completed_at":"2026-08-20T08:19:08.476Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015464,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.206708] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.513Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"28b1b6c8c0f257cc19a3f679","created_at":"2026-08-20T08:19:07.245Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8ca8a915c93af73e98380cc0cca8962","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:19:07.250Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-28b1b6c8c0f257cc19a3f679: start","job_status":"start","queue_duration_s":1.263334,"scheduling_latency_s":1.263375} gitlab # [ 190.230088] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.537Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 190.237841] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"28b1b6c8c0f257cc19a3f679","created_at":"2026-08-20T08:19:07.245Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8ca8a915c93af73e98380cc0cca8962","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:19:07.250Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-28b1b6c8c0f257cc19a3f679: done: 0.031168 sec","job_status":"done","queue_duration_s":1.263334,"scheduling_latency_s":1.263375,"redis_calls":7,"redis_duration_s":0.002227,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000652,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031168,"completed_at":"2026-08-20T08:19:08.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.272087] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e7523234ec28c86a4f0d7d4","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e7523234ec28c86a4f0d7d4: start","job_status":"start","queue_duration_s":1.314422,"scheduling_latency_s":1.314462} gitlab # [ 190.302684] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e7523234ec28c86a4f0d7d4","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e7523234ec28c86a4f0d7d4: done: 0.030572 sec","job_status":"done","queue_duration_s":1.314422,"scheduling_latency_s":1.314462,"redis_calls":13,"redis_duration_s":0.002804,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000993,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030572,"completed_at":"2026-08-20T08:19:08.609Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.337774] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8914a5728a20f89fb9c3cf7a","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8914a5728a20f89fb9c3cf7a: start","job_status":"start","queue_duration_s":1.380195,"scheduling_latency_s":1.380236} gitlab # [ 190.360920] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8914a5728a20f89fb9c3cf7a","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8914a5728a20f89fb9c3cf7a: done: 0.023229 sec","job_status":"done","queue_duration_s":1.380195,"scheduling_latency_s":1.380236,"redis_calls":13,"redis_duration_s":0.0036690000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001224,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002445,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023229,"completed_at":"2026-08-20T08:19:08.667Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.394560] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dd705ab5018107704b8c0e5","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dd705ab5018107704b8c0e5: start","job_status":"start","queue_duration_s":1.436903,"scheduling_latency_s":1.436943} gitlab # [ 190.424944] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dd705ab5018107704b8c0e5","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dd705ab5018107704b8c0e5: done: 0.030382 sec","job_status":"done","queue_duration_s":1.436903,"scheduling_latency_s":1.436943,"redis_calls":13,"redis_duration_s":0.002908,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030382,"completed_at":"2026-08-20T08:19:08.731Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.458359] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5f2c0a3b19c54d178efa222","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5f2c0a3b19c54d178efa222: start","job_status":"start","queue_duration_s":1.500814,"scheduling_latency_s":1.500854} gitlab # [ 190.488492] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5f2c0a3b19c54d178efa222","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5f2c0a3b19c54d178efa222: done: 0.029972 sec","job_status":"done","queue_duration_s":1.500814,"scheduling_latency_s":1.500854,"redis_calls":13,"redis_duration_s":0.0027489999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001844,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029972,"completed_at":"2026-08-20T08:19:08.795Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.522404] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90311657d0a51c434a4f3c7c","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90311657d0a51c434a4f3c7c: start","job_status":"start","queue_duration_s":1.564247,"scheduling_latency_s":1.564286} gitlab # [ 190.544414] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90311657d0a51c434a4f3c7c","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90311657d0a51c434a4f3c7c: done: 0.022612 sec","job_status":"done","queue_duration_s":1.564247,"scheduling_latency_s":1.564286,"redis_calls":13,"redis_duration_s":0.003602,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001146,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002456,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022612,"completed_at":"2026-08-20T08:19:08.851Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.578673] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7ff3d8b0842818a26c4b63a","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7ff3d8b0842818a26c4b63a: start","job_status":"start","queue_duration_s":1.621198,"scheduling_latency_s":1.621238} gitlab # [ 190.608802] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7ff3d8b0842818a26c4b63a","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7ff3d8b0842818a26c4b63a: done: 0.029793 sec","job_status":"done","queue_duration_s":1.621198,"scheduling_latency_s":1.621238,"redis_calls":13,"redis_duration_s":0.002945,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029793,"completed_at":"2026-08-20T08:19:08.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.642148] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea61dab6b8a7c735b1ff9a5a","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea61dab6b8a7c735b1ff9a5a: start","job_status":"start","queue_duration_s":1.684664,"scheduling_latency_s":1.684704} gitlab # [ 190.664411] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:08.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea61dab6b8a7c735b1ff9a5a","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea61dab6b8a7c735b1ff9a5a: done: 0.022154 sec","job_status":"done","queue_duration_s":1.684664,"scheduling_latency_s":1.684704,"redis_calls":13,"redis_duration_s":0.0031929999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022154,"completed_at":"2026-08-20T08:19:08.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.698147] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f239d0fe1d8b917c582d43e","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f239d0fe1d8b917c582d43e: start","job_status":"start","queue_duration_s":1.740568,"scheduling_latency_s":1.740626} gitlab # [ 190.720683] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f239d0fe1d8b917c582d43e","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f239d0fe1d8b917c582d43e: done: 0.022527 sec","job_status":"done","queue_duration_s":1.740568,"scheduling_latency_s":1.740626,"redis_calls":13,"redis_duration_s":0.003617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001203,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002414,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022527,"completed_at":"2026-08-20T08:19:09.027Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.754464] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28678dc5b5f76c62c2341505","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28678dc5b5f76c62c2341505: start","job_status":"start","queue_duration_s":1.796817,"scheduling_latency_s":1.796855} gitlab # [ 190.784985] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28678dc5b5f76c62c2341505","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28678dc5b5f76c62c2341505: done: 0.030609 sec","job_status":"done","queue_duration_s":1.796817,"scheduling_latency_s":1.796855,"redis_calls":13,"redis_duration_s":0.003222,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030609,"completed_at":"2026-08-20T08:19:09.091Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.821179] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6ee768b77c136e129047089","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6ee768b77c136e129047089: start","job_status":"start","queue_duration_s":1.861663,"scheduling_latency_s":1.861707} gitlab # [ 190.851724] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6ee768b77c136e129047089","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6ee768b77c136e129047089: done: 0.032455 sec","job_status":"done","queue_duration_s":1.861663,"scheduling_latency_s":1.861707,"redis_calls":13,"redis_duration_s":0.002858,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032455,"completed_at":"2026-08-20T08:19:09.158Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.885371] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"102ddc72e7a4f6fe88777ea2","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-102ddc72e7a4f6fe88777ea2: start","job_status":"start","queue_duration_s":1.927852,"scheduling_latency_s":1.927891} gitlab # [ 190.915074] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"102ddc72e7a4f6fe88777ea2","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-102ddc72e7a4f6fe88777ea2: done: 0.029601 sec","job_status":"done","queue_duration_s":1.927852,"scheduling_latency_s":1.927891,"redis_calls":13,"redis_duration_s":0.0026899999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029601,"completed_at":"2026-08-20T08:19:09.221Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 190.949853] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d5ec4b5bec00cef98587f88","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d5ec4b5bec00cef98587f88: start","job_status":"start","queue_duration_s":1.991985,"scheduling_latency_s":1.99203} gitlab # [ 190.981399] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d5ec4b5bec00cef98587f88","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d5ec4b5bec00cef98587f88: done: 0.031861 sec","job_status":"done","queue_duration_s":1.991985,"scheduling_latency_s":1.99203,"redis_calls":13,"redis_duration_s":0.0038120000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031861,"completed_at":"2026-08-20T08:19:09.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.016254] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdc397406863145d30d09700","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdc397406863145d30d09700: start","job_status":"start","queue_duration_s":2.058661,"scheduling_latency_s":2.058709} gitlab # [ 191.039257] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdc397406863145d30d09700","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdc397406863145d30d09700: done: 0.023119 sec","job_status":"done","queue_duration_s":2.058661,"scheduling_latency_s":2.058709,"redis_calls":13,"redis_duration_s":0.002761,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000985,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023119,"completed_at":"2026-08-20T08:19:09.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.058933] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c513c50bd78c298051cea581","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c513c50bd78c298051cea581: start","job_status":"start","queue_duration_s":2.083562,"scheduling_latency_s":2.083604} gitlab # [ 191.081368] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c513c50bd78c298051cea581","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c513c50bd78c298051cea581: done: 0.019165 sec","job_status":"done","queue_duration_s":2.083562,"scheduling_latency_s":2.083604,"redis_calls":13,"redis_duration_s":0.003391,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002268,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019165,"completed_at":"2026-08-20T08:19:09.367Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.100723] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4e2854950041a71f9ee239a","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4e2854950041a71f9ee239a: start","job_status":"start","queue_duration_s":2.104117,"scheduling_latency_s":2.104133} gitlab # [ 191.101615] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4e2854950041a71f9ee239a","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4e2854950041a71f9ee239a: done: 0.010278 sec","job_status":"done","queue_duration_s":2.104117,"scheduling_latency_s":2.104133,"redis_calls":13,"redis_duration_s":0.002554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001767,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010278,"completed_at":"2026-08-20T08:19:09.378Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.119425] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cde4577bfef9ec82ffe00122","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cde4577bfef9ec82ffe00122: start","job_status":"start","queue_duration_s":2.115425,"scheduling_latency_s":2.115438} gitlab # [ 191.156354] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cde4577bfef9ec82ffe00122","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cde4577bfef9ec82ffe00122: done: 0.01918 sec","job_status":"done","queue_duration_s":2.115425,"scheduling_latency_s":2.115438,"redis_calls":13,"redis_duration_s":0.0028799999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01918,"completed_at":"2026-08-20T08:19:09.399Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.160588] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97ed4f365d92cd828a38a516","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97ed4f365d92cd828a38a516: start","job_status":"start","queue_duration_s":2.136796,"scheduling_latency_s":2.136834} gitlab # [ 191.171244] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97ed4f365d92cd828a38a516","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97ed4f365d92cd828a38a516: done: 0.020196 sec","job_status":"done","queue_duration_s":2.136796,"scheduling_latency_s":2.136834,"redis_calls":13,"redis_duration_s":0.003026,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020196,"completed_at":"2026-08-20T08:19:09.421Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.210630] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d0e682f883409d3d7c4b033","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d0e682f883409d3d7c4b033: start","job_status":"start","queue_duration_s":2.157815,"scheduling_latency_s":2.15783} gitlab # [ 191.253105] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d0e682f883409d3d7c4b033","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d0e682f883409d3d7c4b033: done: 0.009495 sec","job_status":"done","queue_duration_s":2.157815,"scheduling_latency_s":2.15783,"redis_calls":13,"redis_duration_s":0.001499,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009495,"completed_at":"2026-08-20T08:19:09.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.285895] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1397d12b7abb294811600db0","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1397d12b7abb294811600db0: start","job_status":"start","queue_duration_s":2.168147,"scheduling_latency_s":2.16816} gitlab # [ 191.286760] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1397d12b7abb294811600db0","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1397d12b7abb294811600db0: done: 0.009131 sec","job_status":"done","queue_duration_s":2.168147,"scheduling_latency_s":2.16816,"redis_calls":13,"redis_duration_s":0.001675,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009131,"completed_at":"2026-08-20T08:19:09.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.291769] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c514f386d088613f97ec1dae","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c514f386d088613f97ec1dae: start","job_status":"start","queue_duration_s":2.17812,"scheduling_latency_s":2.178133} gitlab # [ 191.302315] setup-gitlab-start[2232]: + systemctl restart gitlab-sidekiq.service gitlab # [ 191.302984] runuser[2258]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 191.303699] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c514f386d088613f97ec1dae","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c514f386d088613f97ec1dae: done: 0.00919 sec","job_status":"done","queue_duration_s":2.17812,"scheduling_latency_s":2.178133,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00919,"completed_at":"2026-08-20T08:19:09.451Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.335707] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f3cac5670811b2b6dd477a1","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f3cac5670811b2b6dd477a1: start","job_status":"start","queue_duration_s":2.188069,"scheduling_latency_s":2.188111} gitlab # [ 191.374259] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 191.374946] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f3cac5670811b2b6dd477a1","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f3cac5670811b2b6dd477a1: done: 0.009482 sec","job_status":"done","queue_duration_s":2.188069,"scheduling_latency_s":2.188111,"redis_calls":13,"redis_duration_s":0.001738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009482,"completed_at":"2026-08-20T08:19:09.461Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.376910] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c69d638559995345e6aee4d","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c69d638559995345e6aee4d: start","job_status":"start","queue_duration_s":2.198624,"scheduling_latency_s":2.198637} gitlab # [ 191.417671] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c69d638559995345e6aee4d","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c69d638559995345e6aee4d: done: 0.009124 sec","job_status":"done","queue_duration_s":2.198624,"scheduling_latency_s":2.198637,"redis_calls":13,"redis_duration_s":0.0015540000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009124,"completed_at":"2026-08-20T08:19:09.472Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.418512] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6834c703054204e848efab2","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6834c703054204e848efab2: start","job_status":"start","queue_duration_s":2.208581,"scheduling_latency_s":2.208605} gitlab # [ 191.456778] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6834c703054204e848efab2","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6834c703054204e848efab2: done: 0.009302 sec","job_status":"done","queue_duration_s":2.208581,"scheduling_latency_s":2.208605,"redis_calls":13,"redis_duration_s":0.0015570000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009302,"completed_at":"2026-08-20T08:19:09.482Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.457924] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e26fd1536b09efed94542854","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e26fd1536b09efed94542854: start","job_status":"start","queue_duration_s":2.218739,"scheduling_latency_s":2.218753} gitlab # [ 191.493690] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e26fd1536b09efed94542854","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e26fd1536b09efed94542854: done: 0.013717 sec","job_status":"done","queue_duration_s":2.218739,"scheduling_latency_s":2.218753,"redis_calls":13,"redis_duration_s":0.001908,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013717,"completed_at":"2026-08-20T08:19:09.496Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.498446] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"923b2634537ceb502c502ea7","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-923b2634537ceb502c502ea7: start","job_status":"start","queue_duration_s":2.233844,"scheduling_latency_s":2.233873} gitlab # [ 191.537385] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"923b2634537ceb502c502ea7","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-923b2634537ceb502c502ea7: done: 0.0125 sec","job_status":"done","queue_duration_s":2.233844,"scheduling_latency_s":2.233873,"redis_calls":13,"redis_duration_s":0.0019529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001225,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0125,"completed_at":"2026-08-20T08:19:09.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.539076] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02e6df050605b2c28d466ecc","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02e6df050605b2c28d466ecc: start","job_status":"start","queue_duration_s":2.247332,"scheduling_latency_s":2.24735} gitlab # [ 191.549178] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02e6df050605b2c28d466ecc","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02e6df050605b2c28d466ecc: done: 0.011174 sec","job_status":"done","queue_duration_s":2.247332,"scheduling_latency_s":2.24735,"redis_calls":13,"redis_duration_s":0.0019909999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001267,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011174,"completed_at":"2026-08-20T08:19:09.522Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.598503] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"394772a21e1721717967e4c7","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-394772a21e1721717967e4c7: start","job_status":"start","queue_duration_s":2.259528,"scheduling_latency_s":2.259545} gitlab # [ 191.599205] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"394772a21e1721717967e4c7","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-394772a21e1721717967e4c7: done: 0.010278 sec","job_status":"done","queue_duration_s":2.259528,"scheduling_latency_s":2.259545,"redis_calls":13,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010278,"completed_at":"2026-08-20T08:19:09.534Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.622044] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0993b24c5d6c01bd9cfd1b5","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0993b24c5d6c01bd9cfd1b5: start","job_status":"start","queue_duration_s":2.270721,"scheduling_latency_s":2.270737} gitlab # [ 191.656793] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0993b24c5d6c01bd9cfd1b5","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0993b24c5d6c01bd9cfd1b5: done: 0.009968 sec","job_status":"done","queue_duration_s":2.270721,"scheduling_latency_s":2.270737,"redis_calls":13,"redis_duration_s":0.0017109999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009968,"completed_at":"2026-08-20T08:19:09.545Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.662651] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e66d4ff66245e527b9f761f","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e66d4ff66245e527b9f761f: start","job_status":"start","queue_duration_s":2.281619,"scheduling_latency_s":2.281634} gitlab # [ 191.672808] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e66d4ff66245e527b9f761f","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e66d4ff66245e527b9f761f: done: 0.011363 sec","job_status":"done","queue_duration_s":2.281619,"scheduling_latency_s":2.281634,"redis_calls":13,"redis_duration_s":0.002092,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001336,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011363,"completed_at":"2026-08-20T08:19:09.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.725633] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9147f564061a9a4641b8ee6","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9147f564061a9a4641b8ee6: start","job_status":"start","queue_duration_s":2.294232,"scheduling_latency_s":2.29425} gitlab # [ 191.726413] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9147f564061a9a4641b8ee6","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9147f564061a9a4641b8ee6: done: 0.014396 sec","job_status":"done","queue_duration_s":2.294232,"scheduling_latency_s":2.29425,"redis_calls":13,"redis_duration_s":0.001787,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001189,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014396,"completed_at":"2026-08-20T08:19:09.573Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.768504] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9245dbc352822899243bcb52","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9245dbc352822899243bcb52: start","job_status":"start","queue_duration_s":2.309533,"scheduling_latency_s":2.309547} gitlab # [ 191.769206] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9245dbc352822899243bcb52","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9245dbc352822899243bcb52: done: 0.00934 sec","job_status":"done","queue_duration_s":2.309533,"scheduling_latency_s":2.309547,"redis_calls":13,"redis_duration_s":0.001679,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001144,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00934,"completed_at":"2026-08-20T08:19:09.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 191.784985] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a635f3617b4528ce1d0a753","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a635f3617b4528ce1d0a753: start","job_status":"start","queue_duration_s":2.319711,"scheduling_latency_s":2.319724} gitlab # [ 191.825813] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.604Z","message":"Shutting down"} gitlab # [ 191.826315] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.605Z","message":"Scheduler exiting..."} gitlab # [ 191.826757] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.606Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 191.827336] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:09.606Z","message":"Scheduler exiting..."} gitlab # [ 191.827662] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:10.106Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 191.843325] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:10.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a635f3617b4528ce1d0a753","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":1635,"sidekiq_tid":"madn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a635f3617b4528ce1d0a753: done: 0.566018 sec","job_status":"done","queue_duration_s":2.319711,"scheduling_latency_s":2.319724,"redis_calls":13,"redis_duration_s":0.5535909999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001196,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.552395,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.566018,"completed_at":"2026-08-20T08:19:10.150Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 192.302570] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:10.609Z","message":"Bye!"} gitlab # [ 192.339511] sidekiq-cluster[1635]: {"severity":"INFO","time":"2026-08-20T08:19:10.646Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1635,"worker_id":"sidekiq_0","memwd_rss_bytes":937447424,"retry":0} gitlab # [ 193.508235] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 193.510838] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 193.512730] systemd[1]: gitlab-sidekiq.service: Consumed 1min 551ms CPU time over 1min 58.423s wall clock time, 1017.9M memory peak, 13.7M read from disk. gitlab # [ 193.521731] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 193.526797] setup-gitlab-start[2232]: + mkdir -p /var/lib/secrets gitlab # [ 193.532956] setup-gitlab-start[2232]: + echo nixbot-test-token-of-20-chars gitlab # [ 193.534253] setup-gitlab-start[2232]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 193.540742] setup-gitlab-start[2232]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 194.255643] gitaly[927]: time="2026-08-20T08:19:12.562Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:19:22.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:12.561" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.276119] gitaly[927]: time="2026-08-20T08:19:12.562Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:19:22.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:12.561" grpc.time_ms=0.444 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.366388] gitaly[927]: time="2026-08-20T08:19:12.673Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:19:22.112" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:12.673" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.367925] gitaly[927]: time="2026-08-20T08:19:12.673Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:19:22.112" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:12.673" grpc.time_ms=0.331 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.463959] gitaly[927]: time="2026-08-20T08:19:12.771Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA diskcache=867c9033-50b4-4997-941f-f6e538955d9a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:19:22.157" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:12.718" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.480737] gitaly[927]: time="2026-08-20T08:19:12.788Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1576 command.oublock=32 command.real_time_ms=22 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:19:22.157" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:12.718" grpc.time_ms=52.91 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.517230] gitaly[927]: time="2026-08-20T08:19:12.824Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:19:22.262" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:12.823" pid=927 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 194.518579] gitaly[927]: time="2026-08-20T08:19:12.824Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:19:22.262" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:12.823" grpc.time_ms=1.046 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.553871] gitaly[927]: time="2026-08-20T08:19:12.861Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:19:22.288" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:12.848" grpc.time_ms=12.036 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.634703] gitaly[927]: time="2026-08-20T08:19:12.942Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:19:22.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:12.941" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.657469] gitaly[927]: time="2026-08-20T08:19:12.964Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:19:22.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:12.941" grpc.time_ms=0.534 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.730185] gitaly[927]: time="2026-08-20T08:19:13.037Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA diskcache=0f5b3666-ca1c-4255-83d6-7eb0e60029d7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:19:22.059" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:12.989" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.739706] gitaly[927]: time="2026-08-20T08:19:13.037Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1571 command.oublock=32 command.real_time_ms=22 command.spawn_token_fork_ms=0 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:19:22.059" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:12.989" grpc.time_ms=48.086 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.740826] gitaly[927]: time="2026-08-20T08:19:13.047Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:19:23.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:13.047" pid=927 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 194.742053] gitaly[927]: time="2026-08-20T08:19:13.049Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:19:23.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:13.047" grpc.time_ms=0.963 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.782296] gitaly[927]: time="2026-08-20T08:19:13.089Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:19:23.040" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:13.080" grpc.time_ms=8.751 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.834886] gitaly[927]: time="2026-08-20T08:19:13.142Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:19:23.100" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:13.141" grpc.time_ms=0.488 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.856805] gitaly[927]: time="2026-08-20T08:19:13.164Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:19:23.122" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:13.163" grpc.time_ms=0.459 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 195.502258] gitaly[927]: time="2026-08-20T08:19:13.809Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41CVZ7M7YKYWEEKC0ZHPA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:19:23.242" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:13.802" grpc.time_ms=6.296 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 195.747808] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:14 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 2182 gitlab # [ 195.754217] setup-gitlab-start[2232]: + mkdir -p /tmp/test-flake gitlab # [ 195.756383] setup-gitlab-start[2232]: + cd /tmp/test-flake gitlab # [ 195.758192] setup-gitlab-start[2232]: + git init -b master gitlab # [ 195.774713] setup-gitlab-start[2551]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 195.777458] setup-gitlab-start[2232]: + git config user.name test gitlab # [ 195.779381] setup-gitlab-start[2232]: + git config user.email test@example.com gitlab # [ 195.781548] setup-gitlab-start[2232]: + cat gitlab # [ 195.782915] setup-gitlab-start[2232]: + git add flake.nix gitlab # [ 195.784629] setup-gitlab-start[2232]: + git commit -m 'initial commit' gitlab # [ 195.792330] setup-gitlab-start[2556]: [master (root-commit) 7f57630] initial commit gitlab # [ 195.794669] setup-gitlab-start[2556]: 1 file changed, 10 insertions(+) gitlab # [ 195.795955] setup-gitlab-start[2556]: create mode 100644 flake.nix gitlab # [ 195.798644] setup-gitlab-start[2232]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 195.802286] setup-gitlab-start[2232]: + git push -u origin master gitlab # [ 195.878295] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:14 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 42 gitlab # [ 195.977465] gitaly[927]: time="2026-08-20T08:19:14.284Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F4ENYXEC4A56SP00HWX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:14.272" grpc.time_ms=11.805 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 196.004741] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:14 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 94 gitlab # [ 196.574987] sidekiq-cluster[2504]: {"severity":"INFO","time":"2026-08-20T08:19:14.865Z","message":"Starting cluster with 1 processes"} gitlab # [ 196.718866] gitaly[927]: time="2026-08-20T08:19:15.025Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:19:25.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:15.018" grpc.time_ms=7.055 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 196.786388] gitaly[927]: time="2026-08-20T08:19:15.093Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T08:19:45.082" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T08:19:15.082" grpc.time_ms=11.201 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 196.812835] gitaly[927]: time="2026-08-20T08:19:15.120Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0F41F8GRTAFBF28VG12G041 duration_ms=628ns method=POST pid=927 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 196.851098] gitaly[927]: time="2026-08-20T08:19:15.158Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0F41F8GRTAFBF28VG12G041 duration_ms=37ns method=POST pid=927 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 196.860455] gitaly[927]: time="2026-08-20T08:19:15.159Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:19:14.489" grpc.time_ms=669.087 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 196.916621] gitaly[927]: time="2026-08-20T08:19:15.223Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:19:15.222" grpc.time_ms=1.472 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 196.982380] gitaly[927]: time="2026-08-20T08:19:15.289Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:19:15.288" grpc.time_ms=1.185 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 197.031439] gitaly[927]: time="2026-08-20T08:19:15.338Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:19:15.338" grpc.time_ms=0.61 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 197.140488] gitaly[927]: time="2026-08-20T08:19:15.447Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:19:25.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:15.438" grpc.time_ms=9.137 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.169632] gitaly[927]: time="2026-08-20T08:19:15.476Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1563 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=11 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T08:19:25.023" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:19:15.454" grpc.time_ms=22.581 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.191590] gitaly[927]: time="2026-08-20T08:19:15.488Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0F41F8GRTAFBF28VG12G041 duration_ms=104ns method=POST pid=927 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 197.194759] gitaly[927]: time="2026-08-20T08:19:15.489Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:19:15.383" grpc.time_ms=105.662 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 197.212202] gitaly[927]: time="2026-08-20T08:19:15.519Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 diskcache=b07d9b97-1bb4-43e0-a5c4-92af08fe48ec grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:14.406" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 197.212693] gitaly[927]: time="2026-08-20T08:19:15.519Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=254 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13854 command.oublock=32 command.real_time_ms=1102 command.spawn_token_fork_ms=0 command.system_time_ms=165 command.user_time_ms=89 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:14.406" grpc.time_ms=1112.864 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 197.213703] gitlab-workhorse[826]: time="2026-08-20T08:19:15Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 197.214115] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:15 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1200 gitlab # [ 197.214718] setup-gitlab-start[2560]: To http://gitlab/root/test-flake.git gitlab # [ 197.215261] setup-gitlab-start[2560]: * [new branch] master -> master gitlab # [ 197.236532] setup-gitlab-start[2560]: branch 'master' set up to track 'origin/master'. gitlab # [ 197.240307] systemd[1]: Finished setup-gitlab.service. gitlab # [ 197.242846] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 198.14 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 198.420677] nixbot[2651]: {"ts": "2026-08-20T08:19:16.727Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 198.448694] nixbot[2651]: {"ts": "2026-08-20T08:19:16.756Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 198.480984] nixbot[2651]: {"ts": "2026-08-20T08:19:16.788Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 198.491293] nixbot[2651]: {"ts": "2026-08-20T08:19:16.798Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 198.502306] nixbot[2651]: {"ts": "2026-08-20T08:19:16.809Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 198.515121] nixbot[2651]: {"ts": "2026-08-20T08:19:16.822Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 198.525383] nixbot[2651]: {"ts": "2026-08-20T08:19:16.832Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 198.528571] nixbot[2651]: {"ts": "2026-08-20T08:19:16.835Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 198.537766] nixbot[2651]: {"ts": "2026-08-20T08:19:16.845Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 198.545442] nixbot[2651]: {"ts": "2026-08-20T08:19:16.852Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 198.552574] nixbot[2651]: {"ts": "2026-08-20T08:19:16.859Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 198.562364] nixbot[2651]: {"ts": "2026-08-20T08:19:16.869Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 198.572884] nixbot[2651]: {"ts": "2026-08-20T08:19:16.880Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 198.575976] nixbot[2651]: {"ts": "2026-08-20T08:19:16.883Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 198.581399] nixbot[2651]: {"ts": "2026-08-20T08:19:16.888Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 198.584328] nixbot[2651]: {"ts": "2026-08-20T08:19:16.891Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 198.587273] nixbot[2651]: {"ts": "2026-08-20T08:19:16.894Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 198.589965] nixbot[2651]: {"ts": "2026-08-20T08:19:16.897Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 198.595485] nixbot[2651]: {"ts": "2026-08-20T08:19:16.902Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 198.597943] nixbot[2651]: {"ts": "2026-08-20T08:19:16.905Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 198.600325] nixbot[2651]: {"ts": "2026-08-20T08:19:16.907Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 198.606163] nixbot[2651]: {"ts": "2026-08-20T08:19:16.913Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 198.608456] nixbot[2651]: {"ts": "2026-08-20T08:19:16.915Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 198.612140] nixbot[2651]: {"ts": "2026-08-20T08:19:16.918Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 198.613425] nixbot[2651]: {"ts": "2026-08-20T08:19:16.920Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 198.887396] nixbot[2651]: INFO: Started server process [2651] gitlab # [ 198.889530] nixbot[2651]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 198.903344] nixbot[2651]: INFO: ::ffff:127.0.0.1:41234 - "GET /health HTTP/1.1" 200 OK gitlab # [ 198.908933] systemd[1]: Started nixbot CI service. gitlab # [ 198.915285] systemd[1]: Reached target Multi-User System. gitlab # [ 198.917744] systemd[1]: Startup finished in 1.270s (kernel) + 3.560s (initrd) + 3min 14.085s (userspace) = 3min 18.916s. gitlab # [ 199.115926] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:17 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 212 gitlab # [ 199.121096] nixbot[2651]: {"ts": "2026-08-20T08:19:17.424Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 199.132344] nixbot[2651]: {"ts": "2026-08-20T08:19:17.439Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 199.262222] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 120 gitlab # [ 199.266970] nixbot[2651]: {"ts": "2026-08-20T08:19:17.571Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 199.271985] nixbot[2651]: {"ts": "2026-08-20T08:19:17.573Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 199.414116] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 144 gitlab # [ 199.418892] nixbot[2651]: {"ts": "2026-08-20T08:19:17.722Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab: (finished: waiting for unit nixbot.service, in 2.13 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 199.689972] nixbot[2651]: INFO: ::ffff:127.0.0.1:41242 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 199.794528] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 73 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds) (finished: subtest: project discovered and webhook registered, in 0.11 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 199.853479] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:18 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 21 gitlab # [ 200.001318] gitaly[927]: time="2026-08-20T08:19:18.307Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K0K1T78SFQR20S91MXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:18.294" grpc.time_ms=12.721 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 200.005898] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:18 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 148 gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 200.129658] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:18 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 704 gitlab # [ 200.130926] nixbot[2651]: {"ts": "2026-08-20T08:19:18.438Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 200.183750] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 44 gitlab # [ 200.184561] nixbot[2651]: {"ts": "2026-08-20T08:19:18.491Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 200.233053] gitaly[927]: time="2026-08-20T08:19:18.540Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T08:19:48.032" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T08:19:18.532" grpc.time_ms=7.458 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.288963] gitaly[927]: time="2026-08-20T08:19:18.595Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0F41K5W74C6W629KZWKN389 duration_ms=160ns method=POST pid=927 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 200.295765] nixbot[2651]: {"ts": "2026-08-20T08:19:18.602Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 200.296465] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:18 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 107 gitlab # [ 200.321790] gitaly[927]: time="2026-08-20T08:19:18.628Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0F41K5W74C6W629KZWKN389 duration_ms=32ns method=POST pid=927 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 200.323583] gitaly[927]: time="2026-08-20T08:19:18.628Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:19:18.432" grpc.time_ms=196.173 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 200.346951] gitaly[927]: time="2026-08-20T08:19:18.654Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41KEGMW2Q4K7JA597WMQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T08:19:48.146" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:19:18.646" grpc.time_ms=7.352 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.377815] gitaly[927]: time="2026-08-20T08:19:18.685Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41KEGMW2Q4K7JA597WMQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:19:48.184" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:19:18.684" grpc.time_ms=0.4 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.388063] gitaly[927]: time="2026-08-20T08:19:18.695Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:19:18.694" grpc.time_ms=0.403 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 200.407199] gitaly[927]: time="2026-08-20T08:19:18.714Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41KEGMW2Q4K7JA597WMQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T08:19:28.148" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:19:18.708" grpc.time_ms=5.83 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.427042] gitaly[927]: time="2026-08-20T08:19:18.734Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:19:18.734" grpc.time_ms=0.288 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 200.432074] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 128 gitlab # [ 200.432638] nixbot[2651]: {"ts": "2026-08-20T08:19:18.738Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 200.461056] gitaly[927]: time="2026-08-20T08:19:18.768Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:19:18.768" grpc.time_ms=0.288 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 200.493371] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 57 gitlab # [ 200.494334] nixbot[2651]: {"ts": "2026-08-20T08:19:18.801Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 200.496882] nixbot[2651]: {"ts": "2026-08-20T08:19:18.804Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 200.541635] gitaly[927]: time="2026-08-20T08:19:18.848Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0F41K5W74C6W629KZWKN389 duration_ms=40ns method=POST pid=927 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 200.542043] gitaly[927]: time="2026-08-20T08:19:18.849Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:19:18.800" grpc.time_ms=48.302 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 200.564089] gitaly[927]: time="2026-08-20T08:19:18.871Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 diskcache=83b8430a-3797-45d9-93e2-cc9f03dfea66 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:18.383" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.79 seconds) gitlab # [ 200.564839] gitaly[927]: time="2026-08-20T08:19:18.871Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=159 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=868352 command.minflt=12985 command.oublock=32 command.real_time_ms=477 command.spawn_token_fork_ms=0 command.system_time_ms=101 command.user_time_ms=58 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:18.383" grpc.time_ms=487.891 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab # [ 200.576226] gitlab-workhorse[826]: time="2026-08-20T08:19:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 200.576764] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:18 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 551 gitlab # To http://gitlab/root/test-flake.git gitlab # 7f57630..aab1857 master -> master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 200.600909] gitaly[927]: time="2026-08-20T08:19:18.908Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41KNK6BKHJQSH4Z44CS3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:18.894" grpc.time_ms=13.284 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 200.613070] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 84 gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.06 seconds) gitlab # [ 200.649996] nixbot[2651]: INFO: ::ffff:127.0.0.1:41244 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab # [ 200.706079] gitaly[927]: time="2026-08-20T08:19:19.013Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41KRBA0W41EP80RNA214T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.002" pid=927 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 200.728854] gitaly[927]: time="2026-08-20T08:19:19.013Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41KRBA0W41EP80RNA214T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.002" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 200.748392] gitlab-workhorse[826]: time="2026-08-20T08:19:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 200.750061] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 90 gitlab # [ 200.751721] gitaly[927]: time="2026-08-20T08:19:19.013Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41KRBA0W41EP80RNA214T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.002" grpc.time_ms=10.671 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 200.763508] gitaly[927]: time="2026-08-20T08:19:19.064Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41KV9FEGV6JPA3KNQAQW1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.053" pid=927 remote_ip="2001:db8:1::1" request_sha=55fbfe4d49a63befbbd55b177f9c49265ef2c866 response_bytes=419 span.kind=server system=grpc gitlab # [ 200.772833] gitlab-workhorse[826]: time="2026-08-20T08:19:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=419 gitlab # [ 200.773617] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 419 "" "git/2.55.0" 47 gitlab # [ 200.774435] gitaly[927]: time="2026-08-20T08:19:19.064Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41KV9FEGV6JPA3KNQAQW1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.053" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 200.775225] gitaly[927]: time="2026-08-20T08:19:19.064Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41KV9FEGV6JPA3KNQAQW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.053" grpc.time_ms=11.557 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 200.859026] gitaly[927]: time="2026-08-20T08:19:19.166Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41KYNTBEB17EMP2E1PNEY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.158" grpc.time_ms=7.426 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 200.860138] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 41 gitlab # [ 200.928572] gitaly[927]: time="2026-08-20T08:19:19.235Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41M0PFYQR2B7R217NG5QE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.228" pid=927 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 200.929842] gitaly[927]: time="2026-08-20T08:19:19.236Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41M0PFYQR2B7R217NG5QE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.228" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 200.930884] gitlab-workhorse[826]: time="2026-08-20T08:19:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 200.932054] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 46 gitlab # [ 200.932778] gitaly[927]: time="2026-08-20T08:19:19.236Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41M0PFYQR2B7R217NG5QE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.228" grpc.time_ms=7.349 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.060389] gitaly[927]: time="2026-08-20T08:19:19.366Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41M4YJFHAM2JCP21K78AK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.358" grpc.time_ms=7.601 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.061419] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 41 gitlab # [ 201.145592] gitaly[927]: time="2026-08-20T08:19:19.452Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41M6AB4X20XB99VK15FQG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.437" pid=927 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 201.146741] gitaly[927]: time="2026-08-20T08:19:19.453Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41M6AB4X20XB99VK15FQG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.437" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.193625] gitaly[927]: time="2026-08-20T08:19:19.500Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41M6AB4X20XB99VK15FQG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:19.437" grpc.time_ms=63.711 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.210550] gitlab-workhorse[826]: time="2026-08-20T08:19:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 201.211528] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 147 gitlab # [ 201.330380] gitaly[927]: time="2026-08-20T08:19:19.637Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:19:49.635" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:19:19.636" grpc.time_ms=1.012 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.421467] gitaly[927]: time="2026-08-20T08:19:19.728Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T08:19:49.715" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:19:19.715" grpc.time_ms=12.45 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.463210] gitaly[927]: time="2026-08-20T08:19:19.770Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:19:29.019" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:19:19.760" grpc.time_ms=10.123 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.511775] gitaly[927]: time="2026-08-20T08:19:19.818Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:19:29.067" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:19:19.807" grpc.time_ms=10.965 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.597727] gitaly[927]: time="2026-08-20T08:19:19.905Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:19:29.163" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:19.904" grpc.time_ms=0.559 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 201.645259] gitaly[927]: time="2026-08-20T08:19:19.952Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:19:29.198" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:19:19.938" grpc.time_ms=13.355 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab # [ 201.689584] nixbot[2651]: INFO: ::ffff:127.0.0.1:41254 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab # [ 201.706214] gitaly[927]: time="2026-08-20T08:19:20.013Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:19:20.012" grpc.time_ms=0.821 pid=927 span.kind=server system=grpc gitlab # [ 201.732475] gitaly[927]: time="2026-08-20T08:19:20.039Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:19:20.039" grpc.time_ms=0.409 pid=927 span.kind=server system=grpc gitlab # [ 201.751281] gitaly[927]: time="2026-08-20T08:19:20.058Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 diskcache=66e863ec-d648-4f72-a868-150043ff51e8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:19:29.215" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:19.955" pid=927 ref=refs/keep-around/7f57630119d6df8586da7723a10018403f24a895 remote_ip="2001:db8:1::1" revision=7f57630119d6df8586da7723a10018403f24a895 span.kind=server system=grpc username=root gitlab # [ 201.760895] gitaly[927]: time="2026-08-20T08:19:20.058Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=65 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5407 command.oublock=8 command.real_time_ms=92 command.spawn_token_fork_ms=3 command.system_time_ms=39 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:19:29.215" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:19:19.955" grpc.time_ms=102.977 pid=927 ref=refs/keep-around/7f57630119d6df8586da7723a10018403f24a895 remote_ip="2001:db8:1::1" revision=7f57630119d6df8586da7723a10018403f24a895 span.kind=server system=grpc username=root gitlab # [ 201.761488] gitaly[927]: time="2026-08-20T08:19:20.062Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:19:50.061" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:19:20.062" grpc.time_ms=0.416 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.892851] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 636 gitlab # [ 201.899313] nixbot[2651]: {"ts": "2026-08-20T08:19:20.203Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 \"HTTP/1.1 201 Created\""} gitlab # [ 201.905994] nixbot[2651]: {"ts": "2026-08-20T08:19:20.212Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-7f57630119d6-0"} gitlab # [ 201.971232] systemd[1]: Started Nix Daemon. gitlab # [ 202.035897] nix-daemon[2860]: accepted connection from pid 2854, user nixbot gitlab # [ 202.112935] nix-daemon[2860]: accepted connection from pid 2867, user nixbot gitlab # [ 202.124877] nixbot[2651]: {"ts": "2026-08-20T08:19:20.432Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-7f57630119d6-0", "argv0": "bwrap"} gitlab # [ 202.250877] nix-daemon[2860]: accepted connection from pid 2877, user nixbot gitlab # [ 202.300396] nix-daemon[2860]: accepted connection from pid 2887, user nixbot gitlab # [ 202.374904] nix-daemon[2860]: accepted connection from pid 2894, user nixbot gitlab # [ 202.391233] nix-daemon[2860]: accepted connection from pid 2877, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 202.727494] nixbot[2651]: INFO: ::ffff:127.0.0.1:41264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 203.765836] nixbot[2651]: INFO: ::ffff:127.0.0.1:48780 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 204.805144] nixbot[2651]: INFO: ::ffff:127.0.0.1:48790 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 205.843665] nixbot[2651]: INFO: ::ffff:127.0.0.1:48802 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 206.883928] nixbot[2651]: INFO: ::ffff:127.0.0.1:48804 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab # [ 207.279500] nix-daemon[2860]: accepted connection from pid 2925, user nixbot gitlab # [ 207.318099] gitaly[927]: time="2026-08-20T08:19:25.624Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41T7VCT31PE4CBJD9WYHV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:19:55.622" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:19:25.623" grpc.time_ms=0.94 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.360487] gitaly[927]: time="2026-08-20T08:19:25.667Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F41T7VCT31PE4CBJD9WYHV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:19:35.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:19:25.657" grpc.time_ms=9.897 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.442859] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 185 gitlab # [ 207.448498] nixbot[2651]: {"ts": "2026-08-20T08:19:25.751Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 \"HTTP/1.1 201 Created\""} gitlab # [ 207.490212] gitaly[927]: time="2026-08-20T08:19:25.797Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41TDVS9Y9J9M6Q284VJK4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:19:55.796" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:19:25.796" grpc.time_ms=0.555 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.561985] gitaly[927]: time="2026-08-20T08:19:25.869Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41TDVS9Y9J9M6Q284VJK4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:19:35.117" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:19:25.857" grpc.time_ms=11.137 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.608289] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 159 gitlab # [ 207.614843] nixbot[2651]: {"ts": "2026-08-20T08:19:25.922Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 \"HTTP/1.1 201 Created\""} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 207.925418] nixbot[2651]: INFO: ::ffff:127.0.0.1:48808 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 208.963570] nixbot[2651]: INFO: ::ffff:127.0.0.1:48818 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 210.002434] nixbot[2651]: INFO: ::ffff:127.0.0.1:48824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 211.040067] nixbot[2651]: INFO: ::ffff:127.0.0.1:48830 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab # [ 211.978811] nix-daemon[2860]: accepted connection from pid 2967, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 212.047198] gitaly[927]: time="2026-08-20T08:19:30.353Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41YW8V72VMSZS963R9RR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:00.351" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:19:30.352" grpc.time_ms=0.917 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.089906] gitaly[927]: time="2026-08-20T08:19:30.397Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41YW8V72VMSZS963R9RR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:19:40.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:19:30.386" grpc.time_ms=10.262 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.07 seconds) gitlab # [ 212.113307] nixbot[2651]: INFO: ::ffff:127.0.0.1:48836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab # [ 212.134072] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 127 gitlab # [ 212.136312] nixbot[2651]: {"ts": "2026-08-20T08:19:30.441Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 \"HTTP/1.1 201 Created\""} gitlab # [ 212.194682] nix-daemon[2860]: accepted connection from pid 2984, user nixbot gitlab # [ 212.285547] gitaly[927]: time="2026-08-20T08:19:30.592Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F41Z3KCYWHD5CK3WT9XKBJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:30.580" grpc.time_ms=11.813 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.312203] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 45 gitlab # [ 212.363114] gitaly[927]: time="2026-08-20T08:19:30.670Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41Z52QP8FA2Y92007JXT3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:30.662" pid=927 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 212.383751] gitaly[927]: time="2026-08-20T08:19:30.670Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41Z52QP8FA2Y92007JXT3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:30.662" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.407306] gitlab-workhorse[826]: time="2026-08-20T08:19:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 212.410544] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:19:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 52 gitlab # [ 212.413834] gitaly[927]: time="2026-08-20T08:19:30.670Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41Z52QP8FA2Y92007JXT3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:19:30.662" grpc.time_ms=8.655 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.471472] nix-daemon[2860]: accepted connection from pid 3009, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 213.146720] nixbot[2651]: INFO: ::ffff:127.0.0.1:41452 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 214.184978] nixbot[2651]: INFO: ::ffff:127.0.0.1:41468 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 215.224292] nixbot[2651]: INFO: ::ffff:127.0.0.1:41484 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 216.263974] nixbot[2651]: INFO: ::ffff:127.0.0.1:41500 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 217.302345] nixbot[2651]: INFO: ::ffff:127.0.0.1:41516 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 218.339977] nixbot[2651]: INFO: ::ffff:127.0.0.1:41522 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 219.379079] nixbot[2651]: INFO: ::ffff:127.0.0.1:41532 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 220.418274] nixbot[2651]: INFO: ::ffff:127.0.0.1:41536 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 221.453782] nixbot[2651]: INFO: ::ffff:127.0.0.1:41552 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.03 seconds) gitlab # [ 221.471588] sidekiq-cluster[2593]: 2026-08-20T08:19:39.778Z pid=2593 tid=xah INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2593, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431374336} gitlab # [ 221.640760] sidekiq-cluster[2593]: W, [2026-08-20T08:19:39.947918 #2593] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 221.678134] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:19:39.985Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 222.490652] nixbot[2651]: INFO: ::ffff:127.0.0.1:41568 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab # [ 223.405553] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:19:41.712Z","message":"GitLab reliable fetch activated!"} gitlab # [ 223.407507] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:19:41.712Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 223.527856] nixbot[2651]: INFO: ::ffff:127.0.0.1:55490 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 224.562651] nixbot[2651]: INFO: ::ffff:127.0.0.1:55506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab # [ 225.603560] nixbot[2651]: INFO: ::ffff:127.0.0.1:55510 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 226.638826] nixbot[2651]: INFO: ::ffff:127.0.0.1:55526 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 227.675422] nixbot[2651]: INFO: ::ffff:127.0.0.1:55530 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 228.713230] nixbot[2651]: INFO: ::ffff:127.0.0.1:55534 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 229.755545] nixbot[2651]: INFO: ::ffff:127.0.0.1:55536 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 230.795850] nixbot[2651]: INFO: ::ffff:127.0.0.1:55552 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 231.832253] nixbot[2651]: INFO: ::ffff:127.0.0.1:55568 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 232.872363] nixbot[2651]: INFO: ::ffff:127.0.0.1:55584 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 233.911367] nixbot[2651]: INFO: ::ffff:127.0.0.1:60638 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 234.949977] nixbot[2651]: INFO: ::ffff:127.0.0.1:60646 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 235.987332] nixbot[2651]: INFO: ::ffff:127.0.0.1:60648 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 237.025120] nixbot[2651]: INFO: ::ffff:127.0.0.1:60664 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 238.062066] nixbot[2651]: INFO: ::ffff:127.0.0.1:60668 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 239.099400] nixbot[2651]: INFO: ::ffff:127.0.0.1:60670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 240.136902] nixbot[2651]: INFO: ::ffff:127.0.0.1:60680 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.03 seconds) gitlab # [ 241.174404] nixbot[2651]: INFO: ::ffff:127.0.0.1:60692 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 242.209577] nixbot[2651]: INFO: ::ffff:127.0.0.1:60708 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.03 seconds) gitlab # [ 243.243405] nixbot[2651]: INFO: ::ffff:127.0.0.1:43756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab # [ 243.404985] postgres[3122]: [3122] ERROR: relation "table_without_models" does not exist gitlab # [ 243.406455] postgres[3122]: [3122] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 244.277079] nixbot[2651]: INFO: ::ffff:127.0.0.1:43762 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 245.307213] nixbot[2651]: INFO: ::ffff:127.0.0.1:43764 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.03 seconds) gitlab # [ 245.894045] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:04.200Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 245.895560] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:04.202Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 245.896474] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:04.202Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 245.897531] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:04.202Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 245.898609] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:04.205Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 246.346567] nixbot[2651]: INFO: ::ffff:127.0.0.1:43766 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 247.356072] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b5ae453ad64196b3adb1a61","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b5ae453ad64196b3adb1a61: start","job_status":"start","queue_duration_s":58.398016,"scheduling_latency_s":58.398055} gitlab # [ 247.409344] nixbot[2651]: INFO: ::ffff:127.0.0.1:43774 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.06 seconds) gitlab # [ 247.440446] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b5ae453ad64196b3adb1a61","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b5ae453ad64196b3adb1a61: done: 0.085069 sec","job_status":"done","queue_duration_s":58.398016,"scheduling_latency_s":58.398055,"redis_calls":34,"redis_duration_s":0.0078119999999999995,"redis_read_bytes":920,"redis_write_bytes":3615,"redis_feature_flag_calls":21,"redis_feature_flag_duration_s":0.00492,"redis_feature_flag_read_bytes":910,"redis_feature_flag_write_bytes":2458,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.085069,"completed_at":"2026-08-20T08:20:05.747Z","load_balancing_strategy":"primary","db_duration_s":0.005101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.505643] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3e19cf859e83f87de5f209b","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3e19cf859e83f87de5f209b: start","job_status":"start","queue_duration_s":58.484326,"scheduling_latency_s":58.484343} gitlab # [ 247.516268] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3e19cf859e83f87de5f209b","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3e19cf859e83f87de5f209b: done: 0.010661 sec","job_status":"done","queue_duration_s":58.484326,"scheduling_latency_s":58.484343,"redis_calls":13,"redis_duration_s":0.002542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001722,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010661,"completed_at":"2026-08-20T08:20:05.759Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.550209] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f68725e8e9b10b33389fd224","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f68725e8e9b10b33389fd224: start","job_status":"start","queue_duration_s":58.496054,"scheduling_latency_s":58.496068} gitlab # [ 247.561819] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f68725e8e9b10b33389fd224","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f68725e8e9b10b33389fd224: done: 0.010225 sec","job_status":"done","queue_duration_s":58.496054,"scheduling_latency_s":58.496068,"redis_calls":13,"redis_duration_s":0.0025310000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000768,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001763,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010225,"completed_at":"2026-08-20T08:20:05.770Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.563338] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a27b3485fd96b3411ea71c2b","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a27b3485fd96b3411ea71c2b: start","job_status":"start","queue_duration_s":58.50735,"scheduling_latency_s":58.507362} gitlab # [ 247.568722] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a27b3485fd96b3411ea71c2b","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a27b3485fd96b3411ea71c2b: done: 0.010148 sec","job_status":"done","queue_duration_s":58.50735,"scheduling_latency_s":58.507362,"redis_calls":13,"redis_duration_s":0.002629,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001761,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010148,"completed_at":"2026-08-20T08:20:05.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.620911] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4884154c3ae3d7397994483d","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4884154c3ae3d7397994483d: start","job_status":"start","queue_duration_s":58.518576,"scheduling_latency_s":58.518589} gitlab # [ 247.621971] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4884154c3ae3d7397994483d","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4884154c3ae3d7397994483d: done: 0.012299 sec","job_status":"done","queue_duration_s":58.518576,"scheduling_latency_s":58.518589,"redis_calls":13,"redis_duration_s":0.002809,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001756,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012299,"completed_at":"2026-08-20T08:20:05.795Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.678774] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0703644974d8bc540bf5da83","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0703644974d8bc540bf5da83: start","job_status":"start","queue_duration_s":58.532993,"scheduling_latency_s":58.533022} gitlab # [ 247.679792] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0703644974d8bc540bf5da83","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0703644974d8bc540bf5da83: done: 0.02128 sec","job_status":"done","queue_duration_s":58.532993,"scheduling_latency_s":58.533022,"redis_calls":13,"redis_duration_s":0.003606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002444,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013838,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02128,"completed_at":"2026-08-20T08:20:05.818Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.692373] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"320147b8c1c3099a69a29135","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-320147b8c1c3099a69a29135: start","job_status":"start","queue_duration_s":58.555961,"scheduling_latency_s":58.555987} gitlab # [ 247.730459] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"320147b8c1c3099a69a29135","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-320147b8c1c3099a69a29135: done: 0.013649 sec","job_status":"done","queue_duration_s":58.555961,"scheduling_latency_s":58.555987,"redis_calls":13,"redis_duration_s":0.002741,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001788,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013649,"completed_at":"2026-08-20T08:20:05.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.735381] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"182a7318a23e16b5df2c58dd","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-182a7318a23e16b5df2c58dd: start","job_status":"start","queue_duration_s":58.570699,"scheduling_latency_s":58.570714} gitlab # [ 247.775955] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"182a7318a23e16b5df2c58dd","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-182a7318a23e16b5df2c58dd: done: 0.010897 sec","job_status":"done","queue_duration_s":58.570699,"scheduling_latency_s":58.570714,"redis_calls":13,"redis_duration_s":0.0028940000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010897,"completed_at":"2026-08-20T08:20:05.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.777679] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5b4a215e0e8db01810a6f31","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5b4a215e0e8db01810a6f31: start","job_status":"start","queue_duration_s":58.582706,"scheduling_latency_s":58.58272} gitlab # [ 247.788788] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5b4a215e0e8db01810a6f31","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5b4a215e0e8db01810a6f31: done: 0.01068 sec","job_status":"done","queue_duration_s":58.582706,"scheduling_latency_s":58.58272,"redis_calls":13,"redis_duration_s":0.002717,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001833,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01068,"completed_at":"2026-08-20T08:20:05.857Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.840480] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5a3eb9c5dbe9f4cf9e76820","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5a3eb9c5dbe9f4cf9e76820: start","job_status":"start","queue_duration_s":58.594515,"scheduling_latency_s":58.594528} gitlab # [ 247.841617] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5a3eb9c5dbe9f4cf9e76820","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5a3eb9c5dbe9f4cf9e76820: done: 0.010665 sec","job_status":"done","queue_duration_s":58.594515,"scheduling_latency_s":58.594528,"redis_calls":13,"redis_duration_s":0.00261,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001786,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010665,"completed_at":"2026-08-20T08:20:05.869Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.884797] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5862960c18f054647d003abb","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5862960c18f054647d003abb: start","job_status":"start","queue_duration_s":58.606502,"scheduling_latency_s":58.606516} gitlab # [ 247.885901] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5862960c18f054647d003abb","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5862960c18f054647d003abb: done: 0.010448 sec","job_status":"done","queue_duration_s":58.606502,"scheduling_latency_s":58.606516,"redis_calls":13,"redis_duration_s":0.002522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001719,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010448,"completed_at":"2026-08-20T08:20:05.881Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.922664] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ce3070ad98babb14c91e249","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ce3070ad98babb14c91e249: start","job_status":"start","queue_duration_s":58.618008,"scheduling_latency_s":58.618022} gitlab # [ 247.923754] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ce3070ad98babb14c91e249","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ce3070ad98babb14c91e249: done: 0.01033 sec","job_status":"done","queue_duration_s":58.618008,"scheduling_latency_s":58.618022,"redis_calls":13,"redis_duration_s":0.00247,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001706,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01033,"completed_at":"2026-08-20T08:20:05.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.962823] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"322d8534c225d9ddee4a2167","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-322d8534c225d9ddee4a2167: start","job_status":"start","queue_duration_s":58.629381,"scheduling_latency_s":58.629396} gitlab # [ 247.963845] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"322d8534c225d9ddee4a2167","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-322d8534c225d9ddee4a2167: done: 0.010338 sec","job_status":"done","queue_duration_s":58.629381,"scheduling_latency_s":58.629396,"redis_calls":13,"redis_duration_s":0.002444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001661,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010338,"completed_at":"2026-08-20T08:20:05.904Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.005477] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7f1d1ec68de6de2928a5aaf","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7f1d1ec68de6de2928a5aaf: start","job_status":"start","queue_duration_s":58.640794,"scheduling_latency_s":58.640808} gitlab # [ 248.006685] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7f1d1ec68de6de2928a5aaf","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7f1d1ec68de6de2928a5aaf: done: 0.010478 sec","job_status":"done","queue_duration_s":58.640794,"scheduling_latency_s":58.640808,"redis_calls":13,"redis_duration_s":0.002387,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001648,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010478,"completed_at":"2026-08-20T08:20:05.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.057795] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3dafed90c7a54d4cc2785d1","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3dafed90c7a54d4cc2785d1: start","job_status":"start","queue_duration_s":58.652343,"scheduling_latency_s":58.652358} gitlab # [ 248.058603] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3dafed90c7a54d4cc2785d1","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3dafed90c7a54d4cc2785d1: done: 0.010341 sec","job_status":"done","queue_duration_s":58.652343,"scheduling_latency_s":58.652358,"redis_calls":13,"redis_duration_s":0.002395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001635,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010341,"completed_at":"2026-08-20T08:20:05.927Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.079221] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8826a26277a94277541f7919","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8826a26277a94277541f7919: start","job_status":"start","queue_duration_s":58.663775,"scheduling_latency_s":58.663789} gitlab # [ 248.090221] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8826a26277a94277541f7919","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8826a26277a94277541f7919: done: 0.010287 sec","job_status":"done","queue_duration_s":58.663775,"scheduling_latency_s":58.663789,"redis_calls":13,"redis_duration_s":0.0024879999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010287,"completed_at":"2026-08-20T08:20:05.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.134670] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"812693a0a7fd019d079f91e6","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-812693a0a7fd019d079f91e6: start","job_status":"start","queue_duration_s":58.675132,"scheduling_latency_s":58.675146} gitlab # [ 248.135439] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"812693a0a7fd019d079f91e6","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-812693a0a7fd019d079f91e6: done: 0.010317 sec","job_status":"done","queue_duration_s":58.675132,"scheduling_latency_s":58.675146,"redis_calls":13,"redis_duration_s":0.0024720000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001605,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010317,"completed_at":"2026-08-20T08:20:05.949Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.182622] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37e0c75b9fe8ca1a7291b209","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37e0c75b9fe8ca1a7291b209: start","job_status":"start","queue_duration_s":58.686508,"scheduling_latency_s":58.686522} gitlab # [ 248.183475] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37e0c75b9fe8ca1a7291b209","created_at":"2026-08-20T08:19:06.982Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-f2b13519090d46c5","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1af22a9b78b85ce84a9ebd02d8d7cba0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.264Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37e0c75b9fe8ca1a7291b209: done: 0.010439 sec","job_status":"done","queue_duration_s":58.686508,"scheduling_latency_s":58.686522,"redis_calls":13,"redis_duration_s":0.0025109999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001746,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010439,"completed_at":"2026-08-20T08:20:05.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.207908] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.962Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f81f402cb0bc7092b5962e85","created_at":"2026-08-20T08:19:07.262Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b33ee929e4dbf26f0bd447c023828f69","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.271Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f81f402cb0bc7092b5962e85: start","job_status":"start","queue_duration_s":58.690733,"scheduling_latency_s":58.690746} gitlab # [ 248.220236] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.972Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 248.223216] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.977Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f81f402cb0bc7092b5962e85","created_at":"2026-08-20T08:19:07.262Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b33ee929e4dbf26f0bd447c023828f69","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.271Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f81f402cb0bc7092b5962e85: done: 0.014982 sec","job_status":"done","queue_duration_s":58.690733,"scheduling_latency_s":58.690746,"redis_calls":11,"redis_duration_s":0.002224,"redis_read_bytes":9,"redis_write_bytes":1598,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000848,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":772,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001003,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000373,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014982,"completed_at":"2026-08-20T08:20:05.977Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001007,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.278840] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"25964ee16cc3b83a10201339","created_at":"2026-08-20T08:19:07.287Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5248d31d11d38419c0824211d5ebc590","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:19:07.293Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-25964ee16cc3b83a10201339: start","job_status":"start","queue_duration_s":58.685432,"scheduling_latency_s":58.685447} gitlab # [ 248.279532] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.987Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 248.280219] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.992Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"25964ee16cc3b83a10201339","created_at":"2026-08-20T08:19:07.287Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5248d31d11d38419c0824211d5ebc590","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:19:07.293Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-25964ee16cc3b83a10201339: done: 0.013516 sec","job_status":"done","queue_duration_s":58.685432,"scheduling_latency_s":58.685447,"redis_calls":11,"redis_duration_s":0.002282,"redis_read_bytes":9,"redis_write_bytes":1557,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000893,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":756,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001016,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000373,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013516,"completed_at":"2026-08-20T08:20:05.992Z","load_balancing_strategy":"primary","db_duration_s":0.000762,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.308097] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:05.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4e9f740c250cc12c2e60ed4b","created_at":"2026-08-20T08:19:07.355Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a9ea115855c9921e237e2946abef7c8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.362Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4e9f740c250cc12c2e60ed4b: start","job_status":"start","queue_duration_s":58.630846,"scheduling_latency_s":58.630861} gitlab # [ 248.319995] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.016Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4e9f740c250cc12c2e60ed4b","created_at":"2026-08-20T08:19:07.355Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a9ea115855c9921e237e2946abef7c8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.362Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4e9f740c250cc12c2e60ed4b: done: 0.023634 sec","job_status":"done","queue_duration_s":58.630846,"scheduling_latency_s":58.630861,"redis_calls":14,"redis_duration_s":0.003032,"redis_read_bytes":12,"redis_write_bytes":1967,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000867,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001235,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00780602,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.023634,"completed_at":"2026-08-20T08:20:06.016Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004163,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.362419] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2d044e65f0b9ba43d62af23f","created_at":"2026-08-20T08:19:07.367Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8fd53e0d75209ab358c92a19b5820000","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.379Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2d044e65f0b9ba43d62af23f: start","job_status":"start","queue_duration_s":58.638554,"scheduling_latency_s":58.638568} gitlab # [ 248.368083] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.027Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 248.371405] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2d044e65f0b9ba43d62af23f","created_at":"2026-08-20T08:19:07.367Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8fd53e0d75209ab358c92a19b5820000","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.379Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2d044e65f0b9ba43d62af23f: done: 0.013739 sec","job_status":"done","queue_duration_s":58.638554,"scheduling_latency_s":58.638568,"redis_calls":11,"redis_duration_s":0.002285,"redis_read_bytes":9,"redis_write_bytes":1589,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000915,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":768,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000397,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013739,"completed_at":"2026-08-20T08:20:06.031Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.416169] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"96cca211132612b4927062a2","created_at":"2026-08-20T08:19:07.395Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec130497e56ec66dead7c241458ba447","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.410Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-96cca211132612b4927062a2: start","job_status":"start","queue_duration_s":58.622168,"scheduling_latency_s":58.622182} gitlab # [ 248.417195] gitaly[927]: time="2026-08-20T08:20:06.657Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:16.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:06.649" grpc.time_ms=8.088 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.453313] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"96cca211132612b4927062a2","created_at":"2026-08-20T08:19:07.395Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-af19e3e8482c4bec","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec130497e56ec66dead7c241458ba447","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.410Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-96cca211132612b4927062a2: done: 0.033572 sec","job_status":"done","queue_duration_s":58.622168,"scheduling_latency_s":58.622182,"redis_calls":22,"redis_duration_s":0.004602,"redis_read_bytes":22,"redis_write_bytes":3662,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002109,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1761,"redis_queues_calls":2,"redis_queues_duration_s":0.000316,"redis_queues_read_bytes":3,"redis_queues_write_bytes":817,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001599,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000578,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000319873,"duration_s":0.033572,"completed_at":"2026-08-20T08:20:06.066Z","load_balancing_strategy":"primary","db_duration_s":0.00186,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.492516] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.067Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0568afc3044385b5f77a2bca","created_at":"2026-08-20T08:19:07.842Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-bbb54cbc6dbd4fc2","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a41e45ff1ff15a5e6a5f4ad56706074","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.847Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0568afc3044385b5f77a2bca: start","job_status":"start","queue_duration_s":58.219741,"scheduling_latency_s":58.219755} gitlab # [ 248.493150] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.086Z","message":"No existing merge request to be cleaned up."} gitlab # [ 248.493709] gitaly[927]: time="2026-08-20T08:20:06.667Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:20:16.022" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:20:06.662" grpc.time_ms=5.118 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.494467] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.098Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0568afc3044385b5f77a2bca","created_at":"2026-08-20T08:19:07.842Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-bbb54cbc6dbd4fc2","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a41e45ff1ff15a5e6a5f4ad56706074","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.847Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0568afc3044385b5f77a2bca: done: 0.031079 sec","job_status":"done","queue_duration_s":58.219741,"scheduling_latency_s":58.219755,"redis_calls":14,"redis_duration_s":0.003009,"redis_read_bytes":12,"redis_write_bytes":1678,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000869,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000863,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001277,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":5,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031079,"completed_at":"2026-08-20T08:20:06.098Z","load_balancing_strategy":"primary","db_duration_s":0.007763,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.534675] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.099Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"942c0378059006a3f5c54c53","created_at":"2026-08-20T08:19:07.842Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-bbb54cbc6dbd4fc2","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a41e45ff1ff15a5e6a5f4ad56706074","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.847Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-942c0378059006a3f5c54c53: start","job_status":"start","queue_duration_s":58.251926,"scheduling_latency_s":58.251945} gitlab # [ 248.535369] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.107Z","message":"No existing merge request to be cleaned up."} gitlab # [ 248.535907] gitaly[927]: time="2026-08-20T08:20:06.698Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T08:20:16.051" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:06.691" grpc.time_ms=6.727 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.538089] gitaly[927]: time="2026-08-20T08:20:06.733Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3932 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:06.732" grpc.time_ms=0.262 pid=927 span.kind=server system=grpc gitlab # [ 248.546232] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.112Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"942c0378059006a3f5c54c53","created_at":"2026-08-20T08:19:07.842Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-bbb54cbc6dbd4fc2","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a41e45ff1ff15a5e6a5f4ad56706074","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.847Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-942c0378059006a3f5c54c53: done: 0.012763 sec","job_status":"done","queue_duration_s":58.251926,"scheduling_latency_s":58.251945,"redis_calls":10,"redis_duration_s":0.002103,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000806,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001297,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012763,"completed_at":"2026-08-20T08:20:06.112Z","load_balancing_strategy":"primary","db_duration_s":0.001618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.582963] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.113Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"49c3912ea19e7cddf63084c1","created_at":"2026-08-20T08:19:07.842Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-bbb54cbc6dbd4fc2","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a41e45ff1ff15a5e6a5f4ad56706074","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.847Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-49c3912ea19e7cddf63084c1: start","job_status":"start","queue_duration_s":58.265888,"scheduling_latency_s":58.265903} gitlab # [ 248.587531] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.120Z","message":"No existing merge request to be cleaned up."} gitlab # [ 248.622667] gitaly[927]: time="2026-08-20T08:20:06.754Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3934 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:06.754" grpc.time_ms=0.605 pid=927 span.kind=server system=grpc gitlab # [ 248.623486] gitaly[927]: time="2026-08-20T08:20:06.766Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 diskcache=1dd8365e-933f-4c74-984d-95dae60518a8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:20:16.065" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:20:06.705" pid=927 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 248.624125] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.126Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"49c3912ea19e7cddf63084c1","created_at":"2026-08-20T08:19:07.842Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-bbb54cbc6dbd4fc2","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a41e45ff1ff15a5e6a5f4ad56706074","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.847Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-49c3912ea19e7cddf63084c1: done: 0.012328 sec","job_status":"done","queue_duration_s":58.265888,"scheduling_latency_s":58.265903,"redis_calls":10,"redis_duration_s":0.0020629999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001274,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012328,"completed_at":"2026-08-20T08:20:06.126Z","load_balancing_strategy":"primary","db_duration_s":0.00151,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.667607] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.127Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5ec84c1061b8639fc8c61c84","created_at":"2026-08-20T08:19:07.842Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-bbb54cbc6dbd4fc2","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a41e45ff1ff15a5e6a5f4ad56706074","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.847Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5ec84c1061b8639fc8c61c84: start","job_status":"start","queue_duration_s":58.279363,"scheduling_latency_s":58.279377} gitlab # [ 248.668383] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.134Z","message":"No existing merge request to be cleaned up."} gitlab # [ 248.668876] gitaly[927]: time="2026-08-20T08:20:06.767Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=52 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5078 command.oublock=8 command.real_time_ms=52 command.spawn_token_fork_ms=0 command.system_time_ms=38 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:20:16.065" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:20:06.705" grpc.time_ms=61.004 pid=927 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 248.669588] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.139Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5ec84c1061b8639fc8c61c84","created_at":"2026-08-20T08:19:07.842Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-bbb54cbc6dbd4fc2","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3a41e45ff1ff15a5e6a5f4ad56706074","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:07.847Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5ec84c1061b8639fc8c61c84: done: 0.012324 sec","job_status":"done","queue_duration_s":58.279363,"scheduling_latency_s":58.279377,"redis_calls":10,"redis_duration_s":0.002095,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001288,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012324,"completed_at":"2026-08-20T08:20:06.139Z","load_balancing_strategy":"primary","db_duration_s":0.001521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.689842] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.141Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"79e2cced76c74776444effa1","created_at":"2026-08-20T08:19:12.887Z","trace_propagation_headers":{"sentry-trace":"ecc7e167585b46ed9682a555c96f6f2e-640d5d7382e44258","baggage":"sentry-trace_id=ecc7e167585b46ed9682a555c96f6f2e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41CVZ7M7YKYWEEKC0ZHPA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:12.923Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-79e2cced76c74776444effa1: start","job_status":"start","queue_duration_s":53.218042,"scheduling_latency_s":53.218058} gitlab # [ 248.730429] gitaly[927]: time="2026-08-20T08:20:06.777Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:20:16.137" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:20:06.777" grpc.time_ms=0.095 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.731171] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.241Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"79e2cced76c74776444effa1","created_at":"2026-08-20T08:19:12.887Z","trace_propagation_headers":{"sentry-trace":"ecc7e167585b46ed9682a555c96f6f2e-640d5d7382e44258","baggage":"sentry-trace_id=ecc7e167585b46ed9682a555c96f6f2e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41CVZ7M7YKYWEEKC0ZHPA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:12.923Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-79e2cced76c74776444effa1: done: 0.1008 sec","job_status":"done","queue_duration_s":53.218042,"scheduling_latency_s":53.218058,"redis_calls":13,"redis_duration_s":0.003033,"redis_read_bytes":138,"redis_write_bytes":1593,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000657,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":428,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001283,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.077455095,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.1008,"completed_at":"2026-08-20T08:20:06.241Z","load_balancing_strategy":"primary","db_duration_s":0.049307,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.770564] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.243Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"fa93bf806456409233eb2693","created_at":"2026-08-20T08:19:12.932Z","trace_propagation_headers":{"sentry-trace":"ecc7e167585b46ed9682a555c96f6f2e-640d5d7382e44258","baggage":"sentry-trace_id=ecc7e167585b46ed9682a555c96f6f2e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41CVZ7M7YKYWEEKC0ZHPA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:12.936Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-fa93bf806456409233eb2693: start","job_status":"start","queue_duration_s":53.306701,"scheduling_latency_s":53.306718} gitlab # [ 248.771393] gitaly[927]: time="2026-08-20T08:20:06.786Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=943 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T08:20:16.139" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:06.779" grpc.time_ms=6.634 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.771938] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.322Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"fa93bf806456409233eb2693","created_at":"2026-08-20T08:19:12.932Z","trace_propagation_headers":{"sentry-trace":"ecc7e167585b46ed9682a555c96f6f2e-640d5d7382e44258","baggage":"sentry-trace_id=ecc7e167585b46ed9682a555c96f6f2e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41CVZ7M7YKYWEEKC0ZHPA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:12.936Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-fa93bf806456409233eb2693: done: 0.079462 sec","job_status":"done","queue_duration_s":53.306701,"scheduling_latency_s":53.306718,"redis_calls":14,"redis_duration_s":0.00304,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000576,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001471,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.062426929,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.079462,"completed_at":"2026-08-20T08:20:06.322Z","load_balancing_strategy":"primary","db_duration_s":0.026706,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.807567] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.324Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2a68e8d937fd3570358bfeb1","created_at":"2026-08-20T08:19:13.657Z","trace_propagation_headers":{"sentry-trace":"ecc7e167585b46ed9682a555c96f6f2e-640d5d7382e44258","baggage":"sentry-trace_id=ecc7e167585b46ed9682a555c96f6f2e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41CVZ7M7YKYWEEKC0ZHPA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:13.663Z","job_size_bytes":5,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2a68e8d937fd3570358bfeb1: start","job_status":"start","queue_duration_s":52.660522,"scheduling_latency_s":52.660537} gitlab # [ 248.844349] gitaly[927]: time="2026-08-20T08:20:06.835Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=337 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T08:20:36.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:06.831" grpc.time_ms=3.556 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.844967] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.438Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2a68e8d937fd3570358bfeb1","created_at":"2026-08-20T08:19:13.657Z","trace_propagation_headers":{"sentry-trace":"ecc7e167585b46ed9682a555c96f6f2e-640d5d7382e44258","baggage":"sentry-trace_id=ecc7e167585b46ed9682a555c96f6f2e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41CVZ7M7YKYWEEKC0ZHPA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:13.663Z","job_size_bytes":5,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2a68e8d937fd3570358bfeb1: done: 0.114337 sec","job_status":"done","queue_duration_s":52.660522,"scheduling_latency_s":52.660537,"redis_calls":12,"redis_duration_s":0.002775,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00064,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001748,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000671314,"duration_s":0.114337,"completed_at":"2026-08-20T08:20:06.438Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022039,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.869726] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.439Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"f8203f501ccee0e2da3e8cc3","created_at":"2026-08-20T08:19:13.693Z","trace_propagation_headers":{"sentry-trace":"ecc7e167585b46ed9682a555c96f6f2e-640d5d7382e44258","baggage":"sentry-trace_id=ecc7e167585b46ed9682a555c96f6f2e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41CVZ7M7YKYWEEKC0ZHPA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:13.696Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-f8203f501ccee0e2da3e8cc3: start","job_status":"start","queue_duration_s":52.743071,"scheduling_latency_s":52.743085} gitlab # [ 248.916200] gitaly[927]: time="2026-08-20T08:20:06.854Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:20:16.213" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:20:06.853" grpc.time_ms=0.16 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.916840] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.591Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"f8203f501ccee0e2da3e8cc3","created_at":"2026-08-20T08:19:13.693Z","trace_propagation_headers":{"sentry-trace":"ecc7e167585b46ed9682a555c96f6f2e-640d5d7382e44258","baggage":"sentry-trace_id=ecc7e167585b46ed9682a555c96f6f2e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41CVZ7M7YKYWEEKC0ZHPA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:13.696Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-f8203f501ccee0e2da3e8cc3: done: 0.151768 sec","job_status":"done","queue_duration_s":52.743071,"scheduling_latency_s":52.743085,"redis_calls":11,"redis_duration_s":0.002735,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000917,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000407,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.125,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.125,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000300318,"duration_s":0.151768,"completed_at":"2026-08-20T08:20:06.591Z","load_balancing_strategy":"primary","db_duration_s":0.06877,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.955136] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.592Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"a7c34a2449fde3830f0620b0","created_at":"2026-08-20T08:19:13.699Z","trace_propagation_headers":{"sentry-trace":"ecc7e167585b46ed9682a555c96f6f2e-640d5d7382e44258","baggage":"sentry-trace_id=ecc7e167585b46ed9682a555c96f6f2e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41CVZ7M7YKYWEEKC0ZHPA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:13.702Z","job_size_bytes":89,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-a7c34a2449fde3830f0620b0: start","job_status":"start","queue_duration_s":52.889982,"scheduling_latency_s":52.889997} gitlab # [ 248.955790] gitaly[927]: time="2026-08-20T08:20:06.858Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=345 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T08:20:16.215" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T08:20:06.855" grpc.time_ms=3.374 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.58 seconds) gitlab # [ 248.956459] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.618Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"a7c34a2449fde3830f0620b0","created_at":"2026-08-20T08:19:13.699Z","trace_propagation_headers":{"sentry-trace":"ecc7e167585b46ed9682a555c96f6f2e-640d5d7382e44258","baggage":"sentry-trace_id=ecc7e167585b46ed9682a555c96f6f2e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41CVZ7M7YKYWEEKC0ZHPA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:13.702Z","job_size_bytes":89,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-a7c34a2449fde3830f0620b0: done: 0.025422 sec","job_status":"done","queue_duration_s":52.889982,"scheduling_latency_s":52.889997,"redis_calls":11,"redis_duration_s":0.002244,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000589,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001269,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000386,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000279644,"duration_s":0.025422,"completed_at":"2026-08-20T08:20:06.618Z","load_balancing_strategy":"primary","db_duration_s":0.004918,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.012850] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.619Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 7f57630119d6df8586da7723a10018403f24a895 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6e1203957feb1c42b2ff02c0","created_at":"2026-08-20T08:19:15.419Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-299d9c28be7d49ae","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:15.425Z","job_size_bytes":185,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6e1203957feb1c42b2ff02c0: start","job_status":"start","queue_duration_s":51.193471,"scheduling_latency_s":51.193484} gitlab # [ 249.013045] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:06.630Z","message":"changes: \"0000000000000000000000000000000000000000 7f57630119d6df8586da7723a10018403f24a895 refs/heads/master\\n\""} gitlab # [ 249.013533] gitaly[927]: time="2026-08-20T08:20:06.870Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:16.225" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:06.866" grpc.time_ms=4.305 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.017977] nixbot[2651]: INFO: ::ffff:127.0.0.1:43782 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab # [ 249.019440] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.255Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 7f57630119d6df8586da7723a10018403f24a895 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6e1203957feb1c42b2ff02c0","created_at":"2026-08-20T08:19:15.419Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-299d9c28be7d49ae","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:15.425Z","job_size_bytes":185,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6e1203957feb1c42b2ff02c0: done: 0.635931 sec","job_status":"done","queue_duration_s":51.193471,"scheduling_latency_s":51.193484,"gitaly_calls":13,"gitaly_duration_s":0.13534,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.028824,"redis_read_bytes":2104,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.002227,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.004716,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001278,"redis_queues_read_bytes":11,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003063,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.011512,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.006028,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.15,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.164,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.437683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000428546,"exclusive_lock_hold_duration_s":0.02185641,"duration_s":0.635931,"completed_at":"2026-08-20T08:20:07.255Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.053863,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 249.073786] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.256Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","7f57630119d6df8586da7723a10018403f24a895 aab18575c397c4351a711768fd911ae879f3a63c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7218c76e10082f2f57910212","created_at":"2026-08-20T08:19:18.829Z","trace_propagation_headers":{"sentry-trace":"d1bb1599130142318f7e7319279fc24f-b1f90cc800324f56","baggage":"sentry-trace_id=d1bb1599130142318f7e7319279fc24f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41K5W74C6W629KZWKN389","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:18.830Z","job_size_bytes":185,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7218c76e10082f2f57910212: start","job_status":"start","queue_duration_s":48.425958,"scheduling_latency_s":48.425972} gitlab # [ 249.109631] gitaly[927]: time="2026-08-20T08:20:06.877Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:16.232" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:06.873" grpc.time_ms=4.252 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.110258] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.264Z","message":"changes: \"7f57630119d6df8586da7723a10018403f24a895 aab18575c397c4351a711768fd911ae879f3a63c refs/heads/master\\n\""} gitlab # [ 249.110674] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.292Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d0bb9beaac6c69f15e56a873","created_at":"2026-08-20T08:20:07.291Z","trace_propagation_headers":{"sentry-trace":"d1bb1599130142318f7e7319279fc24f-cfe2d82fda5242ef","baggage":"sentry-trace_id=d1bb1599130142318f7e7319279fc24f,sentry-release=Unknown"},"correlation_id":"01M0F41K5W74C6W629KZWKN389","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"996a3a9505c922e23028ad69","job_size_bytes":46,"pid":2593,"job_status":"deduplicated","message":"ProjectCacheWorker JID-d0bb9beaac6c69f15e56a873: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 249.111418] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.389Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","7f57630119d6df8586da7723a10018403f24a895 aab18575c397c4351a711768fd911ae879f3a63c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7218c76e10082f2f57910212","created_at":"2026-08-20T08:19:18.829Z","trace_propagation_headers":{"sentry-trace":"d1bb1599130142318f7e7319279fc24f-b1f90cc800324f56","baggage":"sentry-trace_id=d1bb1599130142318f7e7319279fc24f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41K5W74C6W629KZWKN389","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:19:18.830Z","job_size_bytes":185,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7218c76e10082f2f57910212: done: 0.133548 sec","job_status":"done","queue_duration_s":48.425958,"scheduling_latency_s":48.425972,"gitaly_calls":7,"gitaly_duration_s":0.038604,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.01215,"redis_read_bytes":501,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.001207,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000498,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.004582,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.004444,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000715175,"exclusive_lock_hold_duration_s":0.011125716,"duration_s":0.133548,"completed_at":"2026-08-20T08:20:07.389Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014135,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 249.151734] gitaly[927]: time="2026-08-20T08:20:06.891Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T08:20:36.083" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:06.883" grpc.time_ms=7.546 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.190056] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.391Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8f99913905e869d4c3826abf","created_at":"2026-08-20T08:19:20.067Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-72756429681d47c6","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:20.095Z","job_size_bytes":65,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8f99913905e869d4c3826abf: start","job_status":"start","queue_duration_s":47.29581,"scheduling_latency_s":47.295828} gitlab # [ 249.190597] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.439Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8f99913905e869d4c3826abf","created_at":"2026-08-20T08:19:20.067Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-72756429681d47c6","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:20.095Z","job_size_bytes":65,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8f99913905e869d4c3826abf: done: 0.048774 sec","job_status":"done","queue_duration_s":47.29581,"scheduling_latency_s":47.295828,"redis_calls":16,"redis_duration_s":0.002045,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001101,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000241092,"duration_s":0.048774,"completed_at":"2026-08-20T08:20:07.439Z","load_balancing_strategy":"primary","db_duration_s":0.009874,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 249.207249] gitaly[927]: time="2026-08-20T08:20:07.234Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T08:20:17.002" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:07.232" grpc.time_ms=1.169 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.245752] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.440Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"3515514ed51de062e7319534","created_at":"2026-08-20T08:19:20.095Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-72756429681d47c6","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:20.098Z","job_size_bytes":65,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-3515514ed51de062e7319534: start","job_status":"start","queue_duration_s":47.342009,"scheduling_latency_s":47.342023} gitlab # [ 249.246355] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.498Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"3515514ed51de062e7319534","created_at":"2026-08-20T08:19:20.095Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-72756429681d47c6","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:20.098Z","job_size_bytes":65,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-3515514ed51de062e7319534: done: 0.058014 sec","job_status":"done","queue_duration_s":47.342009,"scheduling_latency_s":47.342023,"redis_calls":21,"redis_duration_s":0.003287,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001242,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001321,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000215391,"duration_s":0.058014,"completed_at":"2026-08-20T08:20:07.498Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.297232] gitaly[927]: time="2026-08-20T08:20:07.280Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:17.045" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:07.275" grpc.time_ms=5.366 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.297870] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.500Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"39e6a3cb50c14ab156beaaaa","created_at":"2026-08-20T08:19:20.182Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-72756429681d47c6","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:20.187Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-39e6a3cb50c14ab156beaaaa: start","job_status":"start","queue_duration_s":47.313173,"scheduling_latency_s":47.313187} gitlab # [ 249.299958] gitaly[927]: time="2026-08-20T08:20:07.289Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:20:17.053" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:20:07.283" grpc.time_ms=5.542 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.304113] gitaly[927]: time="2026-08-20T08:20:07.304Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T08:20:17.069" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:07.300" grpc.time_ms=4.771 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.349654] gitaly[927]: time="2026-08-20T08:20:07.313Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T08:20:37.008" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:07.308" grpc.time_ms=4.982 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.350513] gitaly[927]: time="2026-08-20T08:20:07.322Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T08:20:17.089" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T08:20:07.319" grpc.time_ms=2.608 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.351108] gitaly[927]: time="2026-08-20T08:20:07.331Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:17.096" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:07.327" grpc.time_ms=4.051 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.351648] gitaly[927]: time="2026-08-20T08:20:07.378Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T08:20:17.147" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:07.377" grpc.time_ms=0.797 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.362412] gitaly[927]: time="2026-08-20T08:20:07.605Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:07.604" grpc.time_ms=0.266 pid=927 span.kind=server system=grpc gitlab # [ 249.398669] gitaly[927]: time="2026-08-20T08:20:07.625Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:07.625" grpc.time_ms=0.213 pid=927 span.kind=server system=grpc gitlab # [ 249.399507] gitaly[927]: time="2026-08-20T08:20:07.643Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:07.642" grpc.time_ms=0.316 pid=927 span.kind=server system=grpc gitlab # [ 249.400128] gitaly[927]: time="2026-08-20T08:20:07.651Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 diskcache=3487c4d6-17e4-4ed3-97e3-cd57d283ad04 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:20:37.284" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:07.585" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.400673] gitaly[927]: time="2026-08-20T08:20:07.651Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=68 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7719 command.oublock=0 command.real_time_ms=60 command.spawn_token_fork_ms=0 command.system_time_ms=43 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:20:37.284" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:07.585" grpc.time_ms=66.157 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.413326] gitaly[927]: time="2026-08-20T08:20:07.720Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:20:37.419" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:07.720" grpc.time_ms=0.66 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.436219] gitaly[927]: time="2026-08-20T08:20:07.743Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:37.442" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:07.742" grpc.time_ms=0.534 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.442614] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.749Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"39e6a3cb50c14ab156beaaaa","created_at":"2026-08-20T08:19:20.182Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-72756429681d47c6","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:20.187Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2593,"job_status":"rescheduled","message":"PipelineProcessWorker JID-39e6a3cb50c14ab156beaaaa: rescheduled"} gitlab # [ 249.447993] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.755Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"39e6a3cb50c14ab156beaaaa","created_at":"2026-08-20T08:19:20.182Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-72756429681d47c6","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:19:20.187Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-39e6a3cb50c14ab156beaaaa: done: 0.254877 sec","job_status":"done","queue_duration_s":47.313173,"scheduling_latency_s":47.313187,"gitaly_calls":3,"gitaly_duration_s":0.073608,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014136,"redis_read_bytes":463,"redis_write_bytes":29297,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00075,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000796,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.005081,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.002179,"redis_queues_read_bytes":40,"redis_queues_write_bytes":15584,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.002806,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000357,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000303,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001114,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.012,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.018,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.136145,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.22033861799999999,"duration_s":0.254877,"completed_at":"2026-08-20T08:20:07.755Z","load_balancing_strategy":"primary","db_duration_s":0.039477,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 249.489358] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"4b44cd9f3013e30c0dfc4419","created_at":"2026-08-20T08:20:06.046Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-7fb27e28c02f4c69","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"ec130497e56ec66dead7c241458ba447","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.061Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-4b44cd9f3013e30c0dfc4419: start","job_status":"start","queue_duration_s":1.69491,"scheduling_latency_s":1.694924} gitlab # [ 249.495235] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"4b44cd9f3013e30c0dfc4419","created_at":"2026-08-20T08:20:06.046Z","trace_propagation_headers":{"sentry-trace":"af5b4ad09171481bbfa9129156caa2b4-7fb27e28c02f4c69","baggage":"sentry-trace_id=af5b4ad09171481bbfa9129156caa2b4,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"ec130497e56ec66dead7c241458ba447","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.061Z","job_size_bytes":2,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-4b44cd9f3013e30c0dfc4419: done: 0.018401 sec","job_status":"done","queue_duration_s":1.69491,"scheduling_latency_s":1.694924,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":12,"redis_write_bytes":1665,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000726,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000192483,"duration_s":0.018401,"completed_at":"2026-08-20T08:20:07.774Z","load_balancing_strategy":"primary","db_duration_s":0.002349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.548293] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.775Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"996a3a9505c922e23028ad69","created_at":"2026-08-20T08:20:06.669Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-7fc376eeefb14033","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.673Z","job_size_bytes":46,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-996a3a9505c922e23028ad69: start","job_status":"start","queue_duration_s":1.101757,"scheduling_latency_s":1.101771} gitlab # [ 249.548924] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.845Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"996a3a9505c922e23028ad69","created_at":"2026-08-20T08:20:06.669Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-7fc376eeefb14033","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.673Z","job_size_bytes":46,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-996a3a9505c922e23028ad69: done: 0.070174 sec","job_status":"done","queue_duration_s":1.101757,"scheduling_latency_s":1.101771,"gitaly_calls":2,"gitaly_duration_s":0.011264,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.004194,"redis_read_bytes":69,"redis_write_bytes":4885,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000752,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000335,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2113,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.001711,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00036,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000226845,"duration_s":0.070174,"completed_at":"2026-08-20T08:20:07.845Z","load_balancing_strategy":"primary","db_duration_s":0.007938,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 249.601197] gitaly[927]: time="2026-08-20T08:20:07.814Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T14:20:07.811" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:20:07.811" grpc.time_ms=2.162 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.601946] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.846Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"843847ff5f1738ee90d38811","created_at":"2026-08-20T08:20:06.685Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-7fc376eeefb14033","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.688Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-843847ff5f1738ee90d38811: start","job_status":"start","queue_duration_s":1.158286,"scheduling_latency_s":1.1583} gitlab # [ 249.642627] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.903Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"843847ff5f1738ee90d38811","created_at":"2026-08-20T08:20:06.685Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-7fc376eeefb14033","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.688Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-843847ff5f1738ee90d38811: done: 0.056809 sec","job_status":"done","queue_duration_s":1.158286,"scheduling_latency_s":1.1583,"gitaly_calls":1,"gitaly_duration_s":0.019442,"redis_calls":15,"redis_duration_s":0.002064,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000368,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000679,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.041961478,"duration_s":0.056809,"completed_at":"2026-08-20T08:20:07.903Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009076,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 249.683997] gitaly[927]: time="2026-08-20T08:20:07.827Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T08:20:37.021" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:07.821" grpc.time_ms=5.101 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.684660] gitaly[927]: time="2026-08-20T08:20:07.879Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 diskcache=add67500-b46c-4d32-8316-03f7d9d0bf9b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:20:07.861" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:07.861" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.685463] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.904Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"e1361b567d27ccc959c2b685","created_at":"2026-08-20T08:20:06.774Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-7fc376eeefb14033","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.775Z","job_size_bytes":23,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-e1361b567d27ccc959c2b685: start","job_status":"start","queue_duration_s":1.129217,"scheduling_latency_s":1.129231} gitlab # [ 249.686097] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.931Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"e1361b567d27ccc959c2b685","created_at":"2026-08-20T08:20:06.774Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-7fc376eeefb14033","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.775Z","job_size_bytes":23,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-e1361b567d27ccc959c2b685: done: 0.026839 sec","job_status":"done","queue_duration_s":1.129217,"scheduling_latency_s":1.129231,"gitaly_calls":1,"gitaly_duration_s":0.006272,"redis_calls":16,"redis_duration_s":0.002186,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.0002,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.00094,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026839,"completed_at":"2026-08-20T08:20:07.931Z","load_balancing_strategy":"primary","db_duration_s":0.001486,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 249.726801] gitaly[927]: time="2026-08-20T08:20:07.879Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1284 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:20:07.861" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:07.861" grpc.time_ms=17.789 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.738178] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:07.932Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c0ae58472ecd86e95d227bb9","created_at":"2026-08-20T08:20:07.069Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-7fc376eeefb14033","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5b8cad7815af1db5c0d5961a378878e0ae4b9c4fd9a35182ecc3fec33fa730fe","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.072Z","job_size_bytes":467,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c0ae58472ecd86e95d227bb9: start","job_status":"start","queue_duration_s":0.860231,"scheduling_latency_s":0.860247} gitlab # [ 249.781522] gitaly[927]: time="2026-08-20T08:20:07.926Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T08:20:37.120" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:07.921" grpc.time_ms=4.705 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.782245] gitaly[927]: time="2026-08-20T08:20:07.947Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:37.147" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:07.947" grpc.time_ms=0.32 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.782829] gitaly[927]: time="2026-08-20T08:20:07.954Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:20:17.009" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:07.949" grpc.time_ms=4.808 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.787488] gitaly[927]: time="2026-08-20T08:20:08.023Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:20:38.022" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:08.022" grpc.time_ms=0.609 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.831745] gitaly[927]: time="2026-08-20T08:20:08.028Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=48 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T08:20:38.026" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:08.026" grpc.time_ms=1.586 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 249.832526] gitaly[927]: time="2026-08-20T08:20:08.085Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:18.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:08.080" grpc.time_ms=5.488 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 250.049581] nixbot[2651]: INFO: ::ffff:127.0.0.1:43792 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.06 seconds) gitlab # [ 250.214166] gitaly[927]: time="2026-08-20T08:20:08.521Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T08:20:38.503" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:08.504" grpc.time_ms=17.288 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.260898] gitaly[927]: time="2026-08-20T08:20:08.568Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41F8GRTAFBF28VG12G041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T08:20:38.551" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:08.551" grpc.time_ms=16.308 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.282918] sidekiq-cluster[2593]: {"severity":"WARN","time":"2026-08-20T08:20:08.590Z","class":"CreatePipelineWorker","correlation_id":"01M0F41F8GRTAFBF28VG12G041","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"7f57630119d6df8586da7723a10018403f24a895","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"7f57630119d6df8586da7723a10018403f24a895","ref":"refs/heads/master"},"retry":0} gitlab # [ 250.288257] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:08.595Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c0ae58472ecd86e95d227bb9","created_at":"2026-08-20T08:20:07.069Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-7fc376eeefb14033","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5b8cad7815af1db5c0d5961a378878e0ae4b9c4fd9a35182ecc3fec33fa730fe","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.072Z","job_size_bytes":467,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c0ae58472ecd86e95d227bb9: done: 0.662856 sec","job_status":"done","queue_duration_s":0.860231,"scheduling_latency_s":0.860247,"gitaly_calls":7,"gitaly_duration_s":0.086341,"redis_calls":51,"redis_duration_s":0.0070160000000000005,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.000526,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003063,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001059,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001494,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.533274,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000288025,"duration_s":0.662856,"completed_at":"2026-08-20T08:20:08.595Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033938,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 250.293400] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:08.596Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"f0a8574f-eab7-4768-a9cd-37789bbb4bb0\"}"],"class":"WebHookWorker","jid":"b3090197ad00587c89aa5e0a","created_at":"2026-08-20T08:20:07.212Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-7fc376eeefb14033","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a9ec7483b175b3d7253b73bbb71908da877cea000d5ef8d0914a6cc7688dfbe5","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.217Z","job_size_bytes":1751,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b3090197ad00587c89aa5e0a: start","job_status":"start","queue_duration_s":1.379331,"scheduling_latency_s":1.379346} gitlab # [ 250.402090] nixbot[2651]: INFO: ::ffff:127.0.0.1:43802 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 250.421611] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:08.728Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"f0a8574f-eab7-4768-a9cd-37789bbb4bb0\"}"],"class":"WebHookWorker","jid":"b3090197ad00587c89aa5e0a","created_at":"2026-08-20T08:20:07.212Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-7fc376eeefb14033","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a9ec7483b175b3d7253b73bbb71908da877cea000d5ef8d0914a6cc7688dfbe5","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.217Z","job_size_bytes":1751,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b3090197ad00587c89aa5e0a: done: 0.131863 sec","job_status":"done","queue_duration_s":1.379331,"scheduling_latency_s":1.379346,"redis_calls":19,"redis_duration_s":0.004096,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001021,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000365,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001891,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000819,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.05594537799998989,"cpu_s":0.062657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000574095,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.131863,"completed_at":"2026-08-20T08:20:08.728Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.476633] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:08.729Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"452f25c9f4ebacae52d6078e","created_at":"2026-08-20T08:20:07.296Z","trace_propagation_headers":{"sentry-trace":"d1bb1599130142318f7e7319279fc24f-cfe2d82fda5242ef","baggage":"sentry-trace_id=d1bb1599130142318f7e7319279fc24f,sentry-release=Unknown"},"correlation_id":"01M0F41K5W74C6W629KZWKN389","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"843847ff5f1738ee90d38811","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.297Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-452f25c9f4ebacae52d6078e: start","job_status":"start","queue_duration_s":1.432167,"scheduling_latency_s":1.432182} gitlab # [ 250.476985] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:08.765Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"452f25c9f4ebacae52d6078e","created_at":"2026-08-20T08:20:07.296Z","trace_propagation_headers":{"sentry-trace":"d1bb1599130142318f7e7319279fc24f-cfe2d82fda5242ef","baggage":"sentry-trace_id=d1bb1599130142318f7e7319279fc24f,sentry-release=Unknown"},"correlation_id":"01M0F41K5W74C6W629KZWKN389","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"843847ff5f1738ee90d38811","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.297Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-452f25c9f4ebacae52d6078e: done: 0.03542 sec","job_status":"done","queue_duration_s":1.432167,"scheduling_latency_s":1.432182,"gitaly_calls":1,"gitaly_duration_s":0.012888,"redis_calls":12,"redis_duration_s":0.002218,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000523,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.022516549,"duration_s":0.03542,"completed_at":"2026-08-20T08:20:08.765Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004589,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.518375] gitaly[927]: time="2026-08-20T08:20:08.754Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 diskcache=078974de-210e-4af9-bd36-6d685acd290b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:20:08.742" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:08.743" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.518928] gitaly[927]: time="2026-08-20T08:20:08.754Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=314 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:20:08.742" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:08.743" grpc.time_ms=11.179 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.519528] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:08.766Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"389ed8df88ab84676b7a521e","created_at":"2026-08-20T08:20:07.359Z","trace_propagation_headers":{"sentry-trace":"d1bb1599130142318f7e7319279fc24f-cfe2d82fda5242ef","baggage":"sentry-trace_id=d1bb1599130142318f7e7319279fc24f,sentry-release=Unknown"},"correlation_id":"01M0F41K5W74C6W629KZWKN389","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8d5d343cad5a86f979039dfe2d589e43dd72dca8df280b335476a696a788b7f0","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.360Z","job_size_bytes":467,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-389ed8df88ab84676b7a521e: start","job_status":"start","queue_duration_s":1.40568,"scheduling_latency_s":1.405695} gitlab # [ 250.563391] gitaly[927]: time="2026-08-20T08:20:08.870Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:38.868" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:08.869" grpc.time_ms=0.812 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.575345] gitaly[927]: time="2026-08-20T08:20:08.880Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:20:18.002" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:08.872" grpc.time_ms=7.942 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.586602] gitaly[927]: time="2026-08-20T08:20:08.893Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F434D8VY97BQ8NSRRZCAYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:08.869" grpc.time_ms=24.555 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 250.599221] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 160 gitlab # [ 250.600261] gitaly[927]: time="2026-08-20T08:20:08.907Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:20:38.006" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:08.906" grpc.time_ms=0.435 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.617111] gitaly[927]: time="2026-08-20T08:20:08.923Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=65 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T08:20:38.021" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:08.921" grpc.time_ms=1.763 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.653927] gitaly[927]: time="2026-08-20T08:20:08.961Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:18.014" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:08.954" grpc.time_ms=6.209 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.688121] gitaly[927]: time="2026-08-20T08:20:08.995Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F434JCDKM3M7T8BBKJD2G6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:08.989" pid=927 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 250.689218] gitaly[927]: time="2026-08-20T08:20:08.995Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F434JCDKM3M7T8BBKJD2G6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:08.989" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 250.693745] gitlab-workhorse[826]: time="2026-08-20T08:20:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 250.694374] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 92 gitlab # [ 250.710929] gitaly[927]: time="2026-08-20T08:20:08.995Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F434JCDKM3M7T8BBKJD2G6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:08.989" grpc.time_ms=6.307 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 250.737312] nixbot[2651]: {"ts": "2026-08-20T08:20:09.044Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 250.786086] gitaly[927]: time="2026-08-20T08:20:09.093Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F434PZYQFRJ81NDHDTB8YK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:39.092" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:09.092" grpc.time_ms=0.574 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.857891] gitaly[927]: time="2026-08-20T08:20:09.165Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F434PZYQFRJ81NDHDTB8YK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:19.145" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:09.156" grpc.time_ms=8.505 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 250.926172] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 174 gitlab # [ 250.928141] nixbot[2651]: {"ts": "2026-08-20T08:20:09.231Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 \"HTTP/1.1 201 Created\""} gitlab # [ 250.978865] gitaly[927]: time="2026-08-20T08:20:09.286Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F434WWW9SGC9AFDZSBY6FS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:39.284" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:09.285" grpc.time_ms=0.8 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 251.032566] gitaly[927]: time="2026-08-20T08:20:09.339Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T08:20:39.329" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:09.329" grpc.time_ms=9.359 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 251.058312] gitaly[927]: time="2026-08-20T08:20:09.344Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F434WWW9SGC9AFDZSBY6FS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:19.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:09.339" grpc.time_ms=5.039 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 251.058894] sidekiq-cluster[2593]: {"severity":"WARN","time":"2026-08-20T08:20:09.357Z","class":"CreatePipelineWorker","correlation_id":"01M0F41K5W74C6W629KZWKN389","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"7f57630119d6df8586da7723a10018403f24a895","after":"aab18575c397c4351a711768fd911ae879f3a63c","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"aab18575c397c4351a711768fd911ae879f3a63c","ref":"refs/heads/master"},"retry":0} gitlab # [ 251.059450] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.361Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"389ed8df88ab84676b7a521e","created_at":"2026-08-20T08:20:07.359Z","trace_propagation_headers":{"sentry-trace":"d1bb1599130142318f7e7319279fc24f-cfe2d82fda5242ef","baggage":"sentry-trace_id=d1bb1599130142318f7e7319279fc24f,sentry-release=Unknown"},"correlation_id":"01M0F41K5W74C6W629KZWKN389","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8d5d343cad5a86f979039dfe2d589e43dd72dca8df280b335476a696a788b7f0","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.360Z","job_size_bytes":467,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-389ed8df88ab84676b7a521e: done: 0.595073 sec","job_status":"done","queue_duration_s":1.40568,"scheduling_latency_s":1.405695,"gitaly_calls":7,"gitaly_duration_s":0.136921,"redis_calls":33,"redis_duration_s":0.014453,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000518,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.012446,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000632,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.410229,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.595073,"completed_at":"2026-08-20T08:20:09.361Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029427,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 251.077835] gitaly[927]: time="2026-08-20T08:20:09.348Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41K5W74C6W629KZWKN389 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T08:20:39.340" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:09.341" grpc.time_ms=7.382 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 251.113478] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.362Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"3b1cde99-6f5f-47f2-9068-18ff8d1868fc\"}"],"class":"WebHookWorker","jid":"e809a44a1850024ba8f0a689","created_at":"2026-08-20T08:20:07.368Z","trace_propagation_headers":{"sentry-trace":"d1bb1599130142318f7e7319279fc24f-cfe2d82fda5242ef","baggage":"sentry-trace_id=d1bb1599130142318f7e7319279fc24f,sentry-release=Unknown"},"correlation_id":"01M0F41K5W74C6W629KZWKN389","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:975c63714957e3738188c97e09632b6cbd54187c3160a39c5af3188949007746","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.370Z","job_size_bytes":1749,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e809a44a1850024ba8f0a689: start","job_status":"start","queue_duration_s":1.992394,"scheduling_latency_s":1.992412} gitlab # [ 251.142552] nixbot[2651]: INFO: ::ffff:127.0.0.1:43814 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 251.151684] nixbot[2651]: INFO: ::ffff:127.0.0.1:43820 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.10 seconds) gitlab # [ 251.164081] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.470Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"3b1cde99-6f5f-47f2-9068-18ff8d1868fc\"}"],"class":"WebHookWorker","jid":"e809a44a1850024ba8f0a689","created_at":"2026-08-20T08:20:07.368Z","trace_propagation_headers":{"sentry-trace":"d1bb1599130142318f7e7319279fc24f-cfe2d82fda5242ef","baggage":"sentry-trace_id=d1bb1599130142318f7e7319279fc24f,sentry-release=Unknown"},"correlation_id":"01M0F41K5W74C6W629KZWKN389","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:975c63714957e3738188c97e09632b6cbd54187c3160a39c5af3188949007746","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.370Z","job_size_bytes":1749,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e809a44a1850024ba8f0a689: done: 0.108171 sec","job_status":"done","queue_duration_s":1.992394,"scheduling_latency_s":1.992412,"redis_calls":14,"redis_duration_s":0.0077469999999999995,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.001779,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005043,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.007288076999998339,"cpu_s":0.024512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.108171,"completed_at":"2026-08-20T08:20:09.470Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001616,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.171090] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.476Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"edd97a1f22271f3f42652b61","created_at":"2026-08-20T08:20:07.575Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.577Z","job_size_bytes":23,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-edd97a1f22271f3f42652b61: start","job_status":"start","queue_duration_s":1.898514,"scheduling_latency_s":1.898553} gitlab # [ 251.180373] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 242 gitlab # [ 251.182746] nixbot[2651]: {"ts": "2026-08-20T08:20:09.490Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 \"HTTP/1.1 201 Created\""} gitlab # [ 251.220626] gitaly[927]: time="2026-08-20T08:20:09.517Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F43541GQRE9SRT6NKZ4P20 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:09.510" grpc.time_ms=6.319 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 251.221425] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 44 gitlab # [ 251.228202] gitaly[927]: time="2026-08-20T08:20:09.535Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4354NWRY7C2VFJEMYBDTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:39.534" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:09.534" grpc.time_ms=0.764 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 251.234680] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.541Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"edd97a1f22271f3f42652b61","created_at":"2026-08-20T08:20:07.575Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.577Z","job_size_bytes":23,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-edd97a1f22271f3f42652b61: done: 0.065435 sec","job_status":"done","queue_duration_s":1.898514,"scheduling_latency_s":1.898553,"redis_calls":10,"redis_duration_s":0.0023150000000000002,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000612,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001232,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217067,"duration_s":0.065435,"completed_at":"2026-08-20T08:20:09.541Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010365,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 251.275617] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.542Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b433180f7891355b760f3d7f","created_at":"2026-08-20T08:20:07.655Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.659Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b433180f7891355b760f3d7f: start","job_status":"start","queue_duration_s":1.883601,"scheduling_latency_s":1.883614} gitlab # [ 251.275995] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.567Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b433180f7891355b760f3d7f","created_at":"2026-08-20T08:20:07.655Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.659Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b433180f7891355b760f3d7f: done: 0.024932 sec","job_status":"done","queue_duration_s":1.883601,"scheduling_latency_s":1.883614,"redis_calls":10,"redis_duration_s":0.003013,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000351,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001107,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001555,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000343619,"duration_s":0.024932,"completed_at":"2026-08-20T08:20:09.567Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.315643] gitaly[927]: time="2026-08-20T08:20:09.573Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F4354NWRY7C2VFJEMYBDTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:19.238" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:09.568" grpc.time_ms=4.89 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 251.316270] nixbot[2651]: {"ts": "2026-08-20T08:20:09.605Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 \"HTTP/1.1 201 Created\""} gitlab # [ 251.316785] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7f57630119d6df8586da7723a10018403f24a895 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 111 gitlab # [ 251.317434] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.569Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d65e5d94752af826b1fa13d2","created_at":"2026-08-20T08:20:07.668Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.672Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d65e5d94752af826b1fa13d2: start","job_status":"start","queue_duration_s":1.896697,"scheduling_latency_s":1.89671} gitlab # [ 251.352944] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.590Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d65e5d94752af826b1fa13d2","created_at":"2026-08-20T08:20:07.668Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.672Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d65e5d94752af826b1fa13d2: done: 0.021182 sec","job_status":"done","queue_duration_s":1.896697,"scheduling_latency_s":1.89671,"redis_calls":10,"redis_duration_s":0.001691,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000574,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000235784,"duration_s":0.021182,"completed_at":"2026-08-20T08:20:09.590Z","load_balancing_strategy":"primary","db_duration_s":0.002936,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.390967] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.591Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"3a448b8b61b30fb45fa72b90","created_at":"2026-08-20T08:20:07.680Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.683Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-3a448b8b61b30fb45fa72b90: start","job_status":"start","queue_duration_s":1.907871,"scheduling_latency_s":1.907884} gitlab # [ 251.391619] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.614Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"3a448b8b61b30fb45fa72b90","created_at":"2026-08-20T08:20:07.680Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.683Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-3a448b8b61b30fb45fa72b90: done: 0.023241 sec","job_status":"done","queue_duration_s":1.907871,"scheduling_latency_s":1.907884,"redis_calls":13,"redis_duration_s":0.002623,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000459,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001397,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000438,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000329,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234108,"duration_s":0.023241,"completed_at":"2026-08-20T08:20:09.614Z","load_balancing_strategy":"primary","db_duration_s":0.003141,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.433033] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.615Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d4ea8619f4ddc3fa16ce17eb","created_at":"2026-08-20T08:20:07.683Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.686Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d4ea8619f4ddc3fa16ce17eb: start","job_status":"start","queue_duration_s":1.929489,"scheduling_latency_s":1.929502} gitlab # [ 251.433629] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.635Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d4ea8619f4ddc3fa16ce17eb","created_at":"2026-08-20T08:20:07.683Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.686Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d4ea8619f4ddc3fa16ce17eb: done: 0.020129 sec","job_status":"done","queue_duration_s":1.929489,"scheduling_latency_s":1.929502,"redis_calls":10,"redis_duration_s":0.001346,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203377,"duration_s":0.020129,"completed_at":"2026-08-20T08:20:09.635Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003017,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.471938] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.636Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8dc41643a7d34270d42bc4ee","created_at":"2026-08-20T08:20:07.686Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.688Z","job_size_bytes":19,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8dc41643a7d34270d42bc4ee: start","job_status":"start","queue_duration_s":1.947634,"scheduling_latency_s":1.947647} gitlab # [ 251.472613] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.654Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8dc41643a7d34270d42bc4ee","created_at":"2026-08-20T08:20:07.686Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.688Z","job_size_bytes":19,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8dc41643a7d34270d42bc4ee: done: 0.017875 sec","job_status":"done","queue_duration_s":1.947634,"scheduling_latency_s":1.947647,"redis_calls":11,"redis_duration_s":0.001583,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001028,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205333,"duration_s":0.017875,"completed_at":"2026-08-20T08:20:09.654Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.506973] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.655Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ee66766dc540b2cc652dd896","created_at":"2026-08-20T08:20:07.690Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.693Z","job_size_bytes":66,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ee66766dc540b2cc652dd896: start","job_status":"start","queue_duration_s":1.962372,"scheduling_latency_s":1.962384} gitlab # [ 251.520978] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.675Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ee66766dc540b2cc652dd896","created_at":"2026-08-20T08:20:07.690Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.693Z","job_size_bytes":66,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ee66766dc540b2cc652dd896: done: 0.019711 sec","job_status":"done","queue_duration_s":1.962372,"scheduling_latency_s":1.962384,"redis_calls":10,"redis_duration_s":0.0013319999999999999,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213993,"duration_s":0.019711,"completed_at":"2026-08-20T08:20:09.675Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003073,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.560031] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.676Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b8f01f47bb2eb2888b22da17","created_at":"2026-08-20T08:20:07.693Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.695Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b8f01f47bb2eb2888b22da17: start","job_status":"start","queue_duration_s":1.980178,"scheduling_latency_s":1.980191} gitlab # [ 251.607686] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.704Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b8f01f47bb2eb2888b22da17","created_at":"2026-08-20T08:20:07.693Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.695Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b8f01f47bb2eb2888b22da17: done: 0.028673 sec","job_status":"done","queue_duration_s":1.980178,"scheduling_latency_s":1.980191,"redis_calls":10,"redis_duration_s":0.00141,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000245562,"duration_s":0.028673,"completed_at":"2026-08-20T08:20:09.704Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003797,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.610481] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.705Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"62d51b8798b720dc3e227981","created_at":"2026-08-20T08:20:07.699Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.701Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-62d51b8798b720dc3e227981: start","job_status":"start","queue_duration_s":2.004017,"scheduling_latency_s":2.004031} gitlab # [ 251.649616] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.728Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"62d51b8798b720dc3e227981","created_at":"2026-08-20T08:20:07.699Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.701Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-62d51b8798b720dc3e227981: done: 0.022858 sec","job_status":"done","queue_duration_s":2.004017,"scheduling_latency_s":2.004031,"redis_calls":10,"redis_duration_s":0.001263,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209524,"duration_s":0.022858,"completed_at":"2026-08-20T08:20:09.728Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005964,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.693387] gitaly[927]: time="2026-08-20T08:20:09.871Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:09.870" grpc.time_ms=0.305 pid=927 span.kind=server system=grpc gitlab # [ 251.694151] gitaly[927]: time="2026-08-20T08:20:09.890Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:09.889" grpc.time_ms=0.917 pid=927 span.kind=server system=grpc gitlab # [ 251.694709] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.729Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b5266b744ced297a18d87169","created_at":"2026-08-20T08:20:07.702Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.704Z","job_size_bytes":6,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b5266b744ced297a18d87169: start","job_status":"start","queue_duration_s":2.025297,"scheduling_latency_s":2.02531} gitlab # [ 251.695546] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.743Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b5266b744ced297a18d87169","created_at":"2026-08-20T08:20:07.702Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.704Z","job_size_bytes":6,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b5266b744ced297a18d87169: done: 0.014042 sec","job_status":"done","queue_duration_s":2.025297,"scheduling_latency_s":2.02531,"redis_calls":10,"redis_duration_s":0.001252,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197512,"duration_s":0.014042,"completed_at":"2026-08-20T08:20:09.743Z","load_balancing_strategy":"primary","db_duration_s":0.00126,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.735713] gitaly[927]: time="2026-08-20T08:20:09.907Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:09.906" grpc.time_ms=0.207 pid=927 span.kind=server system=grpc gitlab # [ 251.736507] gitaly[927]: time="2026-08-20T08:20:09.917Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 diskcache=b84b4a40-ef51-4754-8c75-141e8688d83a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:20:39.851" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:09.851" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 251.739809] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.744Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1fc7f1ecdfa413beb387eab3","created_at":"2026-08-20T08:20:07.704Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.706Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1fc7f1ecdfa413beb387eab3: start","job_status":"start","queue_duration_s":2.037583,"scheduling_latency_s":2.037595} gitlab # [ 251.752786] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.765Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1fc7f1ecdfa413beb387eab3","created_at":"2026-08-20T08:20:07.704Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.706Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1fc7f1ecdfa413beb387eab3: done: 0.020857 sec","job_status":"done","queue_duration_s":2.037583,"scheduling_latency_s":2.037595,"redis_calls":10,"redis_duration_s":0.00135,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00033,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203936,"duration_s":0.020857,"completed_at":"2026-08-20T08:20:09.765Z","load_balancing_strategy":"primary","db_duration_s":0.00378,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.789936] gitaly[927]: time="2026-08-20T08:20:09.917Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=63 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7431 command.oublock=0 command.real_time_ms=57 command.spawn_token_fork_ms=0 command.system_time_ms=47 command.user_time_ms=16 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:20:39.851" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:09.851" grpc.time_ms=65.504 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 251.798148] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.766Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"a19ce34a4a619b586e1da960","created_at":"2026-08-20T08:20:07.710Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.712Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-a19ce34a4a619b586e1da960: start","job_status":"start","queue_duration_s":2.053756,"scheduling_latency_s":2.05377} gitlab # [ 251.841246] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.809Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"a19ce34a4a619b586e1da960","created_at":"2026-08-20T08:20:07.710Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.712Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-a19ce34a4a619b586e1da960: done: 0.042745 sec","job_status":"done","queue_duration_s":2.053756,"scheduling_latency_s":2.05377,"redis_calls":14,"redis_duration_s":0.002249,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001174,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000839,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023774,"duration_s":0.042745,"completed_at":"2026-08-20T08:20:09.808Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009473,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.846280] gitaly[927]: time="2026-08-20T08:20:09.950Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:20:39.049" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:09.949" grpc.time_ms=0.529 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 251.856926] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.810Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4d6fd51fa8304ddd35bd0af2","created_at":"2026-08-20T08:20:07.749Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.750Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4d6fd51fa8304ddd35bd0af2: start","job_status":"start","queue_duration_s":2.059268,"scheduling_latency_s":2.05929} gitlab # [ 251.869835] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.972Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4d6fd51fa8304ddd35bd0af2","created_at":"2026-08-20T08:20:07.749Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.750Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2593,"job_status":"rescheduled","message":"PipelineProcessWorker JID-4d6fd51fa8304ddd35bd0af2: rescheduled"} gitlab # [ 251.905670] gitaly[927]: time="2026-08-20T08:20:09.968Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F41MCAP6Q1SNHVYMED00K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:39.067" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:09.967" grpc.time_ms=0.374 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 251.906411] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.977Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4d6fd51fa8304ddd35bd0af2","created_at":"2026-08-20T08:20:07.749Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-1189e6746eb745c1","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.750Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4d6fd51fa8304ddd35bd0af2: done: 0.167174 sec","job_status":"done","queue_duration_s":2.059268,"scheduling_latency_s":2.05929,"gitaly_calls":3,"gitaly_duration_s":0.070717,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007838,"redis_read_bytes":149,"redis_write_bytes":18014,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000347,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000578,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.001952,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.002813,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000162,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000557,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073448,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.145152806,"duration_s":0.167174,"completed_at":"2026-08-20T08:20:09.977Z","load_balancing_strategy":"primary","db_duration_s":0.019124,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 251.948704] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:09.978Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"da6cad0a99fefd7a8bece1b7","created_at":"2026-08-20T08:20:07.835Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-e49ac200fd7240b6","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.838Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-da6cad0a99fefd7a8bece1b7: start","job_status":"start","queue_duration_s":2.139579,"scheduling_latency_s":2.139594} gitlab # [ 251.949488] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.011Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"da6cad0a99fefd7a8bece1b7","created_at":"2026-08-20T08:20:07.835Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-e49ac200fd7240b6","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.838Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-da6cad0a99fefd7a8bece1b7: done: 0.033073 sec","job_status":"done","queue_duration_s":2.139579,"scheduling_latency_s":2.139594,"redis_calls":19,"redis_duration_s":0.002619,"redis_read_bytes":22,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000493,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.00033,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001331,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000465,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0049534240000000005,"duration_s":0.033073,"completed_at":"2026-08-20T08:20:10.011Z","load_balancing_strategy":"primary","db_duration_s":0.004911,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.992642] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.012Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b3090197ad00587c89aa5e0a"],"class":"WebHooks::LogExecutionWorker","jid":"730c302317226ea840918b11","created_at":"2026-08-20T08:20:08.712Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-dfa29ad13af643f8","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:df366722828e4841594207dd1a6de78de6607027298ce6f8b964fa3dc4a53ffd","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.719Z","job_size_bytes":2593,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-730c302317226ea840918b11: start","job_status":"start","queue_duration_s":1.292701,"scheduling_latency_s":1.292716} gitlab # [ 251.999941] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.041Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b3090197ad00587c89aa5e0a"],"class":"WebHooks::LogExecutionWorker","jid":"730c302317226ea840918b11","created_at":"2026-08-20T08:20:08.712Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-dfa29ad13af643f8","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:df366722828e4841594207dd1a6de78de6607027298ce6f8b964fa3dc4a53ffd","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.719Z","job_size_bytes":2593,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-730c302317226ea840918b11: done: 0.028646 sec","job_status":"done","queue_duration_s":1.292701,"scheduling_latency_s":1.292716,"redis_calls":10,"redis_duration_s":0.001291,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224888,"duration_s":0.028646,"completed_at":"2026-08-20T08:20:10.041Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.037588] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.042Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e809a44a1850024ba8f0a689"],"class":"WebHooks::LogExecutionWorker","jid":"3ad50c1cc5f0df4973c753da","created_at":"2026-08-20T08:20:09.452Z","trace_propagation_headers":{"sentry-trace":"d1bb1599130142318f7e7319279fc24f-b4ae21647f294472","baggage":"sentry-trace_id=d1bb1599130142318f7e7319279fc24f,sentry-release=Unknown"},"correlation_id":"01M0F41K5W74C6W629KZWKN389","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a34d07a28b55c741d8fcb9a14245a245310fbb1d4fbd9d1ad9f534eb3b4b1b9f","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.456Z","job_size_bytes":2591,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-3ad50c1cc5f0df4973c753da: start","job_status":"start","queue_duration_s":0.585352,"scheduling_latency_s":0.585365} gitlab # [ 252.049854] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.057Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e809a44a1850024ba8f0a689"],"class":"WebHooks::LogExecutionWorker","jid":"3ad50c1cc5f0df4973c753da","created_at":"2026-08-20T08:20:09.452Z","trace_propagation_headers":{"sentry-trace":"d1bb1599130142318f7e7319279fc24f-b4ae21647f294472","baggage":"sentry-trace_id=d1bb1599130142318f7e7319279fc24f,sentry-release=Unknown"},"correlation_id":"01M0F41K5W74C6W629KZWKN389","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a34d07a28b55c741d8fcb9a14245a245310fbb1d4fbd9d1ad9f534eb3b4b1b9f","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.456Z","job_size_bytes":2591,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-3ad50c1cc5f0df4973c753da: done: 0.015269 sec","job_status":"done","queue_duration_s":0.585352,"scheduling_latency_s":0.585365,"redis_calls":7,"redis_duration_s":0.00093,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015269,"completed_at":"2026-08-20T08:20:10.057Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.096093] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.058Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"af7219de211c04a6871b7424","created_at":"2026-08-20T08:20:09.846Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.847Z","job_size_bytes":23,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-af7219de211c04a6871b7424: start","job_status":"start","queue_duration_s":0.210335,"scheduling_latency_s":0.210347} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 252.097481] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.082Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"af7219de211c04a6871b7424","created_at":"2026-08-20T08:20:09.846Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.847Z","job_size_bytes":23,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-af7219de211c04a6871b7424: done: 0.024565 sec","job_status":"done","queue_duration_s":0.210335,"scheduling_latency_s":0.210347,"redis_calls":7,"redis_duration_s":0.000912,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024565,"completed_at":"2026-08-20T08:20:10.082Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004575,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 252.157112] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.083Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3024d63fe16e1ec055cf2f9f","created_at":"2026-08-20T08:20:09.921Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.923Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3024d63fe16e1ec055cf2f9f: start","job_status":"start","queue_duration_s":0.160345,"scheduling_latency_s":0.160359} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) gitlab # [ 252.157735] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.099Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3024d63fe16e1ec055cf2f9f","created_at":"2026-08-20T08:20:09.921Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.923Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3024d63fe16e1ec055cf2f9f: done: 0.015704 sec","job_status":"done","queue_duration_s":0.160345,"scheduling_latency_s":0.160359,"redis_calls":7,"redis_duration_s":0.0008830000000000001,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015704,"completed_at":"2026-08-20T08:20:10.099Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.179121] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.100Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dda8776bc2af09cc709436db","created_at":"2026-08-20T08:20:09.928Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.929Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dda8776bc2af09cc709436db: start","job_status":"start","queue_duration_s":0.171162,"scheduling_latency_s":0.171176} gitlab # [ 252.191997] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.117Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dda8776bc2af09cc709436db","created_at":"2026-08-20T08:20:09.928Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.929Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dda8776bc2af09cc709436db: done: 0.016888 sec","job_status":"done","queue_duration_s":0.171162,"scheduling_latency_s":0.171176,"redis_calls":7,"redis_duration_s":0.000917,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016888,"completed_at":"2026-08-20T08:20:10.117Z","load_balancing_strategy":"primary","db_duration_s":0.003119,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.231243] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.118Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4e1145e0083dc4664f002b0f","created_at":"2026-08-20T08:20:09.934Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.935Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4e1145e0083dc4664f002b0f: start","job_status":"start","queue_duration_s":0.183075,"scheduling_latency_s":0.183089} gitlab # [ 252.238418] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.135Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4e1145e0083dc4664f002b0f","created_at":"2026-08-20T08:20:09.934Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.935Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4e1145e0083dc4664f002b0f: done: 0.017723 sec","job_status":"done","queue_duration_s":0.183075,"scheduling_latency_s":0.183089,"redis_calls":10,"redis_duration_s":0.0012439999999999999,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000353,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017723,"completed_at":"2026-08-20T08:20:10.135Z","load_balancing_strategy":"primary","db_duration_s":0.002591,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.277724] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.136Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e88aab5307a4337dec82d5fb","created_at":"2026-08-20T08:20:09.935Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.936Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e88aab5307a4337dec82d5fb: start","job_status":"start","queue_duration_s":0.200469,"scheduling_latency_s":0.200483} gitlab # [ 252.320348] nixbot[2651]: INFO: ::ffff:127.0.0.1:43834 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab # [ 252.321128] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.151Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e88aab5307a4337dec82d5fb","created_at":"2026-08-20T08:20:09.935Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.936Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e88aab5307a4337dec82d5fb: done: 0.014975 sec","job_status":"done","queue_duration_s":0.200469,"scheduling_latency_s":0.200483,"redis_calls":7,"redis_duration_s":0.000905,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000664,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014975,"completed_at":"2026-08-20T08:20:10.151Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0022,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.328756] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"e8cb17481fa4713069883b31","created_at":"2026-08-20T08:20:09.936Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.938Z","job_size_bytes":19,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-e8cb17481fa4713069883b31: start","job_status":"start","queue_duration_s":0.214507,"scheduling_latency_s":0.214519} gitlab # [ 252.367252] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.166Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"e8cb17481fa4713069883b31","created_at":"2026-08-20T08:20:09.936Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.938Z","job_size_bytes":19,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-e8cb17481fa4713069883b31: done: 0.014167 sec","job_status":"done","queue_duration_s":0.214507,"scheduling_latency_s":0.214519,"redis_calls":8,"redis_duration_s":0.001028,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014167,"completed_at":"2026-08-20T08:20:10.166Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002084,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.378441] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.167Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"004e3a83cb6a92308582e864","created_at":"2026-08-20T08:20:09.938Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.939Z","job_size_bytes":66,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-004e3a83cb6a92308582e864: start","job_status":"start","queue_duration_s":0.227997,"scheduling_latency_s":0.22801} gitlab # [ 252.392581] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.181Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"004e3a83cb6a92308582e864","created_at":"2026-08-20T08:20:09.938Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.939Z","job_size_bytes":66,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-004e3a83cb6a92308582e864: done: 0.013274 sec","job_status":"done","queue_duration_s":0.227997,"scheduling_latency_s":0.22801,"redis_calls":7,"redis_duration_s":0.000951,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013274,"completed_at":"2026-08-20T08:20:10.181Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001471,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.428769] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.181Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5e9c72628ae95966f9621bee","created_at":"2026-08-20T08:20:09.940Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.940Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5e9c72628ae95966f9621bee: start","job_status":"start","queue_duration_s":0.240992,"scheduling_latency_s":0.241005} gitlab # [ 252.470029] gitaly[927]: time="2026-08-20T08:20:10.676Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F4355FXPE0F538QWH0SNK4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:09.564" pid=927 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 252.470918] gitlab-workhorse[826]: time="2026-08-20T08:20:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 252.471454] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1157 gitlab # [ 252.472073] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.197Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5e9c72628ae95966f9621bee","created_at":"2026-08-20T08:20:09.940Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.940Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5e9c72628ae95966f9621bee: done: 0.015979 sec","job_status":"done","queue_duration_s":0.240992,"scheduling_latency_s":0.241005,"redis_calls":7,"redis_duration_s":0.0009789999999999998,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015979,"completed_at":"2026-08-20T08:20:10.197Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.518074] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.198Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1e52f2e000cc4d2403f85357","created_at":"2026-08-20T08:20:09.941Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.942Z","job_size_bytes":6,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1e52f2e000cc4d2403f85357: start","job_status":"start","queue_duration_s":0.256757,"scheduling_latency_s":0.256771} gitlab # [ 252.518744] gitaly[927]: time="2026-08-20T08:20:10.676Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=1109 command.spawn_token_fork_ms=1105 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4355FXPE0F538QWH0SNK4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:09.564" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 252.519471] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.207Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1e52f2e000cc4d2403f85357","created_at":"2026-08-20T08:20:09.941Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.942Z","job_size_bytes":6,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1e52f2e000cc4d2403f85357: done: 0.009008 sec","job_status":"done","queue_duration_s":0.256757,"scheduling_latency_s":0.256771,"redis_calls":7,"redis_duration_s":0.000897,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009008,"completed_at":"2026-08-20T08:20:10.207Z","load_balancing_strategy":"primary","db_duration_s":0.000326,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.560154] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.208Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1e970ce76d5b3fb321dcbd62","created_at":"2026-08-20T08:20:09.942Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.943Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1e970ce76d5b3fb321dcbd62: start","job_status":"start","queue_duration_s":0.265705,"scheduling_latency_s":0.265719} gitlab # [ 252.560779] gitaly[927]: time="2026-08-20T08:20:10.676Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=1109 command.spawn_token_fork_ms=1105 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4355FXPE0F538QWH0SNK4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:09.564" grpc.time_ms=1112.269 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 252.568895] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.222Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1e970ce76d5b3fb321dcbd62","created_at":"2026-08-20T08:20:09.942Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.943Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1e970ce76d5b3fb321dcbd62: done: 0.013737 sec","job_status":"done","queue_duration_s":0.265705,"scheduling_latency_s":0.265719,"redis_calls":7,"redis_duration_s":0.0009599999999999999,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013737,"completed_at":"2026-08-20T08:20:10.222Z","load_balancing_strategy":"primary","db_duration_s":0.001871,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.620027] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.223Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"799205a049bd98add61401d9","created_at":"2026-08-20T08:20:09.973Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.973Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-799205a049bd98add61401d9: start","job_status":"start","queue_duration_s":0.24961,"scheduling_latency_s":0.249623} gitlab # [ 252.620946] nix-daemon[2860]: accepted connection from pid 3367, user nixbot gitlab # [ 252.621542] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 45 gitlab # [ 252.621920] gitlab-workhorse[826]: time="2026-08-20T08:20:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 252.622526] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 46 gitlab # [ 252.623039] gitaly[927]: time="2026-08-20T08:20:10.877Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F436EGTZ53T4G20KBXD16J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:10.866" grpc.time_ms=10.665 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 252.632876] gitaly[927]: time="2026-08-20T08:20:10.925Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F436FZTEVXBYMVEVCHEJ70 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:10.918" pid=927 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 252.642579] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.239Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"799205a049bd98add61401d9","created_at":"2026-08-20T08:20:09.973Z","trace_propagation_headers":{"sentry-trace":"f066dec9437b40bebba419d3b811153d-28b35dc63b504b48","baggage":"sentry-trace_id=f066dec9437b40bebba419d3b811153d,sentry-release=Unknown"},"correlation_id":"01M0F41MCAP6Q1SNHVYMED00K0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:09.973Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-799205a049bd98add61401d9: done: 0.015578 sec","job_status":"done","queue_duration_s":0.24961,"scheduling_latency_s":0.249623,"redis_calls":8,"redis_duration_s":0.001057,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015578,"completed_at":"2026-08-20T08:20:10.239Z","load_balancing_strategy":"primary","db_duration_s":0.002023,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 252.694912] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.240Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"381601fa7c3a00f25a1ad221","created_at":"2026-08-20T08:20:10.002Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-1f1604c3efd44ef6","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:10.005Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-381601fa7c3a00f25a1ad221: start","job_status":"start","queue_duration_s":0.2343,"scheduling_latency_s":0.234313} gitlab # [ 252.695928] gitaly[927]: time="2026-08-20T08:20:10.925Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F436FZTEVXBYMVEVCHEJ70 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:10.918" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 252.700163] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 40 gitlab # [ 252.701928] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:10.295Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"381601fa7c3a00f25a1ad221","created_at":"2026-08-20T08:20:10.002Z","trace_propagation_headers":{"sentry-trace":"11fa560fee684585a67db24263e01856-1f1604c3efd44ef6","baggage":"sentry-trace_id=11fa560fee684585a67db24263e01856,sentry-release=Unknown"},"correlation_id":"01M0F41F8GRTAFBF28VG12G041","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:10.005Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-381601fa7c3a00f25a1ad221: done: 0.055163 sec","job_status":"done","queue_duration_s":0.2343,"scheduling_latency_s":0.234313,"redis_calls":11,"redis_duration_s":0.001501,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213155,"duration_s":0.055163,"completed_at":"2026-08-20T08:20:10.295Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.742640] gitaly[927]: time="2026-08-20T08:20:10.925Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F436FZTEVXBYMVEVCHEJ70 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:10.918" grpc.time_ms=6.662 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 252.785112] gitlab-workhorse[826]: time="2026-08-20T08:20:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 252.785662] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 45 gitlab # [ 252.786140] gitaly[927]: time="2026-08-20T08:20:10.988Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F436J4QFRGM60FXW4K56EF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:10.983" grpc.time_ms=5.111 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 252.786664] gitaly[927]: time="2026-08-20T08:20:11.035Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F436KE15J05JDKRXSQNBMM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:11.025" pid=927 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 252.787422] gitaly[927]: time="2026-08-20T08:20:11.035Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F436KE15J05JDKRXSQNBMM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:11.025" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 252.788059] gitaly[927]: time="2026-08-20T08:20:11.035Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F436KE15J05JDKRXSQNBMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:11.025" grpc.time_ms=9.977 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 252.796221] gitaly[927]: time="2026-08-20T08:20:11.097Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F436NNFZCGX9DTYEVBAC6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:41.096" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:11.097" grpc.time_ms=0.578 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 252.809895] gitaly[927]: time="2026-08-20T08:20:11.117Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F436NNFZCGX9DTYEVBAC6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T08:20:41.111" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:11.111" grpc.time_ms=5.575 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 252.847916] gitaly[927]: time="2026-08-20T08:20:11.126Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F436NNFZCGX9DTYEVBAC6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:21.082" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:11.122" grpc.time_ms=4.153 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 252.851082] gitaly[927]: time="2026-08-20T08:20:11.158Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F436NNFZCGX9DTYEVBAC6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:20:21.117" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:20:11.158" grpc.time_ms=0.194 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 252.859225] gitaly[927]: time="2026-08-20T08:20:11.166Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F436NNFZCGX9DTYEVBAC6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:20:21.121" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:11.161" grpc.time_ms=4.633 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 252.885145] gitaly[927]: time="2026-08-20T08:20:11.192Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F436NNFZCGX9DTYEVBAC6T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:11.192" grpc.time_ms=0.262 pid=927 span.kind=server system=grpc gitlab # [ 252.903880] gitaly[927]: time="2026-08-20T08:20:11.211Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F436NNFZCGX9DTYEVBAC6T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:11.210" grpc.time_ms=0.308 pid=927 span.kind=server system=grpc gitlab # [ 252.919934] gitaly[927]: time="2026-08-20T08:20:11.227Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F436NNFZCGX9DTYEVBAC6T diskcache=8315996a-9f72-4794-96fb-c35aeeb28cbb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:20:21.127" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:20:11.167" pid=927 ref=refs/keep-around/aab18575c397c4351a711768fd911ae879f3a63c remote_ip="2001:db8:1::1" revision=aab18575c397c4351a711768fd911ae879f3a63c span.kind=server system=grpc username=root gitlab # [ 252.920557] gitaly[927]: time="2026-08-20T08:20:11.227Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=41 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5402 command.oublock=8 command.real_time_ms=53 command.spawn_token_fork_ms=0 command.system_time_ms=27 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M0F436NNFZCGX9DTYEVBAC6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:20:21.127" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:20:11.167" grpc.time_ms=59.541 pid=927 ref=refs/keep-around/aab18575c397c4351a711768fd911ae879f3a63c remote_ip="2001:db8:1::1" revision=aab18575c397c4351a711768fd911ae879f3a63c span.kind=server system=grpc username=root gitlab # [ 252.923131] gitaly[927]: time="2026-08-20T08:20:11.230Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F436NNFZCGX9DTYEVBAC6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:41.230" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:11.230" grpc.time_ms=0.23 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 252.930164] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:11.237Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"685a70019595efe190ff37da","created_at":"2026-08-20T08:20:11.233Z","trace_propagation_headers":{"sentry-trace":"73d90247590b48dabee206efec3d50e7-9f19f98340b14889","baggage":"sentry-trace_id=73d90247590b48dabee206efec3d50e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F436NNFZCGX9DTYEVBAC6T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.235Z","job_size_bytes":65,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-685a70019595efe190ff37da: start","job_status":"start","queue_duration_s":0.001273,"scheduling_latency_s":0.001305} gitlab # [ 252.952610] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:11.259Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"685a70019595efe190ff37da","created_at":"2026-08-20T08:20:11.233Z","trace_propagation_headers":{"sentry-trace":"73d90247590b48dabee206efec3d50e7-9f19f98340b14889","baggage":"sentry-trace_id=73d90247590b48dabee206efec3d50e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F436NNFZCGX9DTYEVBAC6T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.235Z","job_size_bytes":65,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-685a70019595efe190ff37da: done: 0.022603 sec","job_status":"done","queue_duration_s":0.001273,"scheduling_latency_s":0.001305,"redis_calls":7,"redis_duration_s":0.001023,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000785,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022603,"completed_at":"2026-08-20T08:20:11.259Z","load_balancing_strategy":"primary","db_duration_s":0.003555,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 252.963851] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:11.260Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"f1f3503087f764f105efdc02","created_at":"2026-08-20T08:20:11.237Z","trace_propagation_headers":{"sentry-trace":"73d90247590b48dabee206efec3d50e7-9f19f98340b14889","baggage":"sentry-trace_id=73d90247590b48dabee206efec3d50e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F436NNFZCGX9DTYEVBAC6T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.240Z","job_size_bytes":65,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-f1f3503087f764f105efdc02: start","job_status":"start","queue_duration_s":0.020369,"scheduling_latency_s":0.020385} gitlab # [ 252.994929] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:11.302Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"f1f3503087f764f105efdc02","created_at":"2026-08-20T08:20:11.237Z","trace_propagation_headers":{"sentry-trace":"73d90247590b48dabee206efec3d50e7-9f19f98340b14889","baggage":"sentry-trace_id=73d90247590b48dabee206efec3d50e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F436NNFZCGX9DTYEVBAC6T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.240Z","job_size_bytes":65,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-f1f3503087f764f105efdc02: done: 0.04113 sec","job_status":"done","queue_duration_s":0.020369,"scheduling_latency_s":0.020385,"redis_calls":10,"redis_duration_s":0.002069,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001319,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.00075,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04113,"completed_at":"2026-08-20T08:20:11.301Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01097,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.032892] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:11.340Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"78781f3b2cebd9577a1d9ef5","created_at":"2026-08-20T08:20:11.336Z","trace_propagation_headers":{"sentry-trace":"73d90247590b48dabee206efec3d50e7-9f19f98340b14889","baggage":"sentry-trace_id=73d90247590b48dabee206efec3d50e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F436NNFZCGX9DTYEVBAC6T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.339Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-78781f3b2cebd9577a1d9ef5: start","job_status":"start","queue_duration_s":0.001017,"scheduling_latency_s":0.001054} gitlab # [ 253.043508] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 289 gitlab # [ 253.044438] nixbot[2651]: {"ts": "2026-08-20T08:20:11.351Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/aab18575c397c4351a711768fd911ae879f3a63c \"HTTP/1.1 201 Created\""} gitlab # [ 253.049278] nixbot[2651]: {"ts": "2026-08-20T08:20:11.356Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-aab18575c397-4"} gitlab # [ 253.089794] nix-daemon[2860]: accepted connection from pid 3425, user nixbot gitlab # [ 253.093603] gitaly[927]: time="2026-08-20T08:20:11.400Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F436NNFZCGX9DTYEVBAC6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:20:41.399" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:11.400" grpc.time_ms=0.544 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.120693] gitaly[927]: time="2026-08-20T08:20:11.428Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F436NNFZCGX9DTYEVBAC6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:41.427" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:11.427" grpc.time_ms=0.453 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.129881] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:11.437Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"78781f3b2cebd9577a1d9ef5","created_at":"2026-08-20T08:20:11.336Z","trace_propagation_headers":{"sentry-trace":"73d90247590b48dabee206efec3d50e7-9f19f98340b14889","baggage":"sentry-trace_id=73d90247590b48dabee206efec3d50e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F436NNFZCGX9DTYEVBAC6T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.339Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-78781f3b2cebd9577a1d9ef5: done: 0.097031 sec","job_status":"done","queue_duration_s":0.001017,"scheduling_latency_s":0.001054,"gitaly_calls":2,"gitaly_duration_s":0.004725,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004757,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000563,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000784,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.00018,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000142,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000363,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066488,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.070552822,"duration_s":0.097031,"completed_at":"2026-08-20T08:20:11.436Z","load_balancing_strategy":"primary","db_duration_s":0.019869,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 253.136339] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:11.442Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2a9e8fa3fb9cfa47d49955d0","created_at":"2026-08-20T08:20:11.386Z","trace_propagation_headers":{"sentry-trace":"73d90247590b48dabee206efec3d50e7-acc68b32b6ac4cc1","baggage":"sentry-trace_id=73d90247590b48dabee206efec3d50e7,sentry-release=Unknown"},"correlation_id":"01M0F436NNFZCGX9DTYEVBAC6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.387Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2a9e8fa3fb9cfa47d49955d0: start","job_status":"start","queue_duration_s":0.054541,"scheduling_latency_s":0.054569} gitlab # [ 253.151094] nix-daemon[2860]: accepted connection from pid 3433, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c' gitlab # [ 253.162467] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:11.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2a9e8fa3fb9cfa47d49955d0","created_at":"2026-08-20T08:20:11.386Z","trace_propagation_headers":{"sentry-trace":"73d90247590b48dabee206efec3d50e7-acc68b32b6ac4cc1","baggage":"sentry-trace_id=73d90247590b48dabee206efec3d50e7,sentry-release=Unknown"},"correlation_id":"01M0F436NNFZCGX9DTYEVBAC6T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.387Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2a9e8fa3fb9cfa47d49955d0: done: 0.027683 sec","job_status":"done","queue_duration_s":0.054541,"scheduling_latency_s":0.054569,"redis_calls":7,"redis_duration_s":0.001968,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000718,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00125,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027683,"completed_at":"2026-08-20T08:20:11.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006069,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.204086] nixbot[2651]: {"ts": "2026-08-20T08:20:11.511Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-aab18575c397-4", "argv0": "bwrap"} gitlab # [ 253.235486] nixbot[2651]: INFO: ::ffff:127.0.0.1:56884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=aab18575c397c4351a711768fd911ae879f3a63c', in 0.04 seconds) (finished: subtest: push delivers the webhook, in 53.44 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/aab18575c397c4351a711768fd911ae879f3a63c/statuses gitlab # [ 253.277999] nix-daemon[2860]: accepted connection from pid 3446, user nixbot gitlab # [ 253.291131] gitaly[927]: time="2026-08-20T08:20:11.598Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F43759H7J1410K2GYKGCR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:41.597" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:11.597" grpc.time_ms=0.56 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.319212] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/aab18575c397c4351a711768fd911ae879f3a63c/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 64 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/aab18575c397c4351a711768fd911ae879f3a63c/statuses, in 0.09 seconds) gitlab # [ 253.325038] nix-daemon[2860]: accepted connection from pid 3462, user nixbot gitlab # [ 253.333821] nix-daemon[2860]: accepted connection from pid 3446, user nixbot gitlab # [ 253.389281] gitaly[927]: time="2026-08-20T08:20:11.696Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:41.695" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:11.696" grpc.time_ms=0.559 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.418499] gitaly[927]: time="2026-08-20T08:20:11.725Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:21.290" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:11.720" grpc.time_ms=5.678 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.445602] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:11.752Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"68a4293dc955127af3eb52d4","created_at":"2026-08-20T08:20:11.748Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-90880cd278054338","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.751Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-68a4293dc955127af3eb52d4: start","job_status":"start","queue_duration_s":0.001338,"scheduling_latency_s":0.001371} gitlab # [ 253.471679] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 115 gitlab # [ 253.475163] nixbot[2651]: {"ts": "2026-08-20T08:20:11.782Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/aab18575c397c4351a711768fd911ae879f3a63c \"HTTP/1.1 201 Created\""} gitlab # [ 253.542619] gitaly[927]: time="2026-08-20T08:20:11.849Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F437CC19FFBG4YMHNN1TG0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:41.847" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:11.848" grpc.time_ms=0.68 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.544566] gitaly[927]: time="2026-08-20T08:20:11.852Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:11.851" grpc.time_ms=0.221 pid=927 span.kind=server system=grpc gitlab # [ 253.572448] gitaly[927]: time="2026-08-20T08:20:11.879Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F437CC19FFBG4YMHNN1TG0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:21.133" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:11.873" grpc.time_ms=6.266 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.589979] gitaly[927]: time="2026-08-20T08:20:11.897Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:11.896" grpc.time_ms=0.463 pid=927 span.kind=server system=grpc gitlab # [ 253.608776] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 127 gitlab # [ 253.611465] nixbot[2651]: {"ts": "2026-08-20T08:20:11.916Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/aab18575c397c4351a711768fd911ae879f3a63c \"HTTP/1.1 201 Created\""} gitlab # [ 253.617755] gitaly[927]: time="2026-08-20T08:20:11.925Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:11.924" grpc.time_ms=0.315 pid=927 span.kind=server system=grpc gitlab # [ 253.629083] gitaly[927]: time="2026-08-20T08:20:11.936Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:20:41.831" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:11.832" operations="[repack_refs]" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.635779] gitaly[927]: time="2026-08-20T08:20:11.943Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT diskcache=627b17f9-3e5c-4afe-9f4d-0ddf1f3744a2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:20:41.831" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:11.832" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.636604] gitaly[927]: time="2026-08-20T08:20:11.943Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=73 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7195 command.oublock=0 command.real_time_ms=103 command.spawn_token_fork_ms=0 command.system_time_ms=42 command.user_time_ms=31 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:20:41.831" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:11.832" grpc.time_ms=110.911 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.658482] gitaly[927]: time="2026-08-20T08:20:11.965Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:20:41.831" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:11.832" pid=927 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-20 08:19:12.747097863 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 253.671706] gitaly[927]: time="2026-08-20T08:20:11.979Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:20:41.831" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:11.832" pid=927 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 253.672564] gitaly[927]: time="2026-08-20T08:20:11.979Z" level=info msg="optimized repository" clean_stale_data_time=12.89745ms clean_work_trees_time="67.047µs" commit_graph_time="3.632µs" correlation_id=01M0F4378EMRYN43THBDK3M5PT gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.632µs" pid=927 prune_time="3.352µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="3.911µs" storage_name=default system=housekeeping total_time=13.069817ms gitlab # [ 253.673334] gitaly[927]: time="2026-08-20T08:20:11.979Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:20:41.831" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:11.832" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.680624] gitaly[927]: time="2026-08-20T08:20:11.988Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:20:41.087" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:11.987" grpc.time_ms=0.522 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.725130] gitaly[927]: time="2026-08-20T08:20:12.031Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:42.030" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:12.031" grpc.time_ms=0.46 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.732229] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.038Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c3a30026c7479710aa224bc8","created_at":"2026-08-20T08:20:12.037Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"68a4293dc955127af3eb52d4","job_size_bytes":3,"pid":2593,"job_status":"deduplicated","message":"PipelineProcessWorker JID-c3a30026c7479710aa224bc8: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 253.733900] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.041Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"68a4293dc955127af3eb52d4","created_at":"2026-08-20T08:20:11.748Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-90880cd278054338","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.751Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2593,"job_status":"rescheduled","message":"PipelineProcessWorker JID-68a4293dc955127af3eb52d4: rescheduled"} gitlab # [ 253.738825] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.046Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"68a4293dc955127af3eb52d4","created_at":"2026-08-20T08:20:11.748Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-90880cd278054338","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.751Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-68a4293dc955127af3eb52d4: done: 0.293448 sec","job_status":"done","queue_duration_s":0.001338,"scheduling_latency_s":0.001371,"gitaly_calls":3,"gitaly_duration_s":0.141356,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.015294,"redis_read_bytes":239,"redis_write_bytes":21785,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001061,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001645,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002675,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14470,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.006284,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000176,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000764,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001628,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096591,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.240995434,"duration_s":0.293448,"completed_at":"2026-08-20T08:20:12.045Z","load_balancing_strategy":"primary","db_duration_s":0.030132,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 253.774795] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.047Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bcb6cc2094c01026ea4a88b1","created_at":"2026-08-20T08:20:11.825Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.827Z","job_size_bytes":23,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bcb6cc2094c01026ea4a88b1: start","job_status":"start","queue_duration_s":0.219353,"scheduling_latency_s":0.219369} gitlab # [ 253.812110] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.077Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bcb6cc2094c01026ea4a88b1","created_at":"2026-08-20T08:20:11.825Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.827Z","job_size_bytes":23,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bcb6cc2094c01026ea4a88b1: done: 0.030186 sec","job_status":"done","queue_duration_s":0.219353,"scheduling_latency_s":0.219369,"redis_calls":7,"redis_duration_s":0.0017699999999999999,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030186,"completed_at":"2026-08-20T08:20:12.077Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005633,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 253.813490] gitaly[927]: time="2026-08-20T08:20:12.055Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F437GQP6P7BTWFPNN3QGHE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:42.054" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:12.055" grpc.time_ms=0.451 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.852930] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.078Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ef477bf398909f09e093b37f","created_at":"2026-08-20T08:20:11.947Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.951Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ef477bf398909f09e093b37f: start","job_status":"start","queue_duration_s":0.127183,"scheduling_latency_s":0.127197} gitlab # [ 253.853539] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.095Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ef477bf398909f09e093b37f","created_at":"2026-08-20T08:20:11.947Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.951Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ef477bf398909f09e093b37f: done: 0.017751 sec","job_status":"done","queue_duration_s":0.127183,"scheduling_latency_s":0.127197,"redis_calls":7,"redis_duration_s":0.002436,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001706,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017751,"completed_at":"2026-08-20T08:20:12.095Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.873178] nixbot[2651]: {"ts": "2026-08-20T08:20:12.124Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/aab18575c397c4351a711768fd911ae879f3a63c \"HTTP/1.1 201 Created\""} gitlab # [ 253.909741] gitaly[927]: time="2026-08-20T08:20:12.087Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F437GQP6P7BTWFPNN3QGHE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:20:22.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:20:12.082" grpc.time_ms=5.138 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 253.910585] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/aab18575c397c4351a711768fd911ae879f3a63c HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 195 gitlab # [ 253.910970] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.096Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9298694bccdab36028f0fd67","created_at":"2026-08-20T08:20:11.957Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.958Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9298694bccdab36028f0fd67: start","job_status":"start","queue_duration_s":0.137908,"scheduling_latency_s":0.137923} gitlab # [ 253.911722] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.115Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9298694bccdab36028f0fd67","created_at":"2026-08-20T08:20:11.957Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.958Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9298694bccdab36028f0fd67: done: 0.018219 sec","job_status":"done","queue_duration_s":0.137908,"scheduling_latency_s":0.137923,"redis_calls":7,"redis_duration_s":0.001016,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018219,"completed_at":"2026-08-20T08:20:12.115Z","load_balancing_strategy":"primary","db_duration_s":0.003004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.947380] nix-daemon[2860]: accepted connection from pid 3515, user nixbot gitlab # [ 253.948037] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.115Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"b494d406b7032935c0222999","created_at":"2026-08-20T08:20:11.964Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.965Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b494d406b7032935c0222999: start","job_status":"start","queue_duration_s":0.15031,"scheduling_latency_s":0.150324} gitlab # [ 253.983089] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.141Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"b494d406b7032935c0222999","created_at":"2026-08-20T08:20:11.964Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.965Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b494d406b7032935c0222999: done: 0.02591 sec","job_status":"done","queue_duration_s":0.15031,"scheduling_latency_s":0.150324,"redis_calls":10,"redis_duration_s":0.005293999999999999,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004565,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000423,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000306,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02591,"completed_at":"2026-08-20T08:20:12.141Z","load_balancing_strategy":"primary","db_duration_s":0.003678,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.984049] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.143Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d62ccbbbc8da91e437441672","created_at":"2026-08-20T08:20:11.965Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.967Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d62ccbbbc8da91e437441672: start","job_status":"start","queue_duration_s":0.176334,"scheduling_latency_s":0.176354} gitlab # [ 253.997910] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.160Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d62ccbbbc8da91e437441672","created_at":"2026-08-20T08:20:11.965Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.967Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d62ccbbbc8da91e437441672: done: 0.016805 sec","job_status":"done","queue_duration_s":0.176334,"scheduling_latency_s":0.176354,"redis_calls":7,"redis_duration_s":0.000872,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000224,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016805,"completed_at":"2026-08-20T08:20:12.160Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.040698] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.165Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0094f0253c161343f6e1ec3c","created_at":"2026-08-20T08:20:11.967Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.968Z","job_size_bytes":19,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0094f0253c161343f6e1ec3c: start","job_status":"start","queue_duration_s":0.197006,"scheduling_latency_s":0.197022} gitlab # [ 254.047612] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.184Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0094f0253c161343f6e1ec3c","created_at":"2026-08-20T08:20:11.967Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.968Z","job_size_bytes":19,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0094f0253c161343f6e1ec3c: done: 0.018631 sec","job_status":"done","queue_duration_s":0.197006,"scheduling_latency_s":0.197022,"redis_calls":8,"redis_duration_s":0.00234,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001898,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000442,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018631,"completed_at":"2026-08-20T08:20:12.184Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003793,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.085801] gitaly[927]: time="2026-08-20T08:20:12.344Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F437SJ24GMHVRH9HKV6K47 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:12.338" grpc.time_ms=5.227 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 254.093585] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 134 gitlab # [ 254.095401] gitlab-workhorse[826]: time="2026-08-20T08:20:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 254.097804] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 50 gitlab # [ 254.098744] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.185Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b57ba1f38957e9c8378315d8","created_at":"2026-08-20T08:20:11.969Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.970Z","job_size_bytes":66,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b57ba1f38957e9c8378315d8: start","job_status":"start","queue_duration_s":0.215055,"scheduling_latency_s":0.21512} gitlab # [ 254.134608] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.204Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b57ba1f38957e9c8378315d8","created_at":"2026-08-20T08:20:11.969Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.970Z","job_size_bytes":66,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b57ba1f38957e9c8378315d8: done: 0.018541 sec","job_status":"done","queue_duration_s":0.215055,"scheduling_latency_s":0.21512,"redis_calls":7,"redis_duration_s":0.001093,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018541,"completed_at":"2026-08-20T08:20:12.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002511,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.148577] gitaly[927]: time="2026-08-20T08:20:12.395Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F437XSMTMVFZBA7N3W699G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:12.389" pid=927 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 254.158768] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.205Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c9c68f5bc7e62f5f26748c5a","created_at":"2026-08-20T08:20:11.971Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.972Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c9c68f5bc7e62f5f26748c5a: start","job_status":"start","queue_duration_s":0.233007,"scheduling_latency_s":0.233026} gitlab # [ 254.170715] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.230Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c9c68f5bc7e62f5f26748c5a","created_at":"2026-08-20T08:20:11.971Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.972Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c9c68f5bc7e62f5f26748c5a: done: 0.025274 sec","job_status":"done","queue_duration_s":0.233007,"scheduling_latency_s":0.233026,"redis_calls":7,"redis_duration_s":0.001265,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001019,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025274,"completed_at":"2026-08-20T08:20:12.230Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.209662] nix-daemon[2860]: accepted connection from pid 3549, user nixbot gitlab # [ 254.210457] gitaly[927]: time="2026-08-20T08:20:12.395Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F437XSMTMVFZBA7N3W699G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:12.389" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 254.216592] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.231Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"7cb8f3ca6ab46ce1e0a113a4","created_at":"2026-08-20T08:20:11.974Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.975Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7cb8f3ca6ab46ce1e0a113a4: start","job_status":"start","queue_duration_s":0.255969,"scheduling_latency_s":0.255986} gitlab # [ 254.230177] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.247Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"7cb8f3ca6ab46ce1e0a113a4","created_at":"2026-08-20T08:20:11.974Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.975Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7cb8f3ca6ab46ce1e0a113a4: done: 0.015753 sec","job_status":"done","queue_duration_s":0.255969,"scheduling_latency_s":0.255986,"redis_calls":7,"redis_duration_s":0.00089,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015753,"completed_at":"2026-08-20T08:20:12.247Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00327,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.278948] gitaly[927]: time="2026-08-20T08:20:12.395Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F437XSMTMVFZBA7N3W699G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:20:12.389" grpc.time_ms=6.688 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 254.279591] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.248Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"deb290a77cec41d677ce9f1e","created_at":"2026-08-20T08:20:11.975Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.976Z","job_size_bytes":6,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-deb290a77cec41d677ce9f1e: start","job_status":"start","queue_duration_s":0.271236,"scheduling_latency_s":0.27125} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/aab18575c397c4351a711768fd911ae879f3a63c/statuses gitlab # [ 254.320231] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.256Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"deb290a77cec41d677ce9f1e","created_at":"2026-08-20T08:20:11.975Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.976Z","job_size_bytes":6,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-deb290a77cec41d677ce9f1e: done: 0.008388 sec","job_status":"done","queue_duration_s":0.271236,"scheduling_latency_s":0.27125,"redis_calls":7,"redis_duration_s":0.000954,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008388,"completed_at":"2026-08-20T08:20:12.256Z","load_balancing_strategy":"primary","db_duration_s":0.000289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.354298] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.257Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"b1cac103c465dcb7ddbb3d01","created_at":"2026-08-20T08:20:11.977Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.977Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b1cac103c465dcb7ddbb3d01: start","job_status":"start","queue_duration_s":0.279298,"scheduling_latency_s":0.279311} gitlab # [ 254.354936] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.270Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"b1cac103c465dcb7ddbb3d01","created_at":"2026-08-20T08:20:11.977Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:11.977Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b1cac103c465dcb7ddbb3d01: done: 0.013361 sec","job_status":"done","queue_duration_s":0.279298,"scheduling_latency_s":0.279311,"redis_calls":7,"redis_duration_s":0.000924,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000276,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013361,"completed_at":"2026-08-20T08:20:12.270Z","load_balancing_strategy":"primary","db_duration_s":0.001902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.396785] sidekiq-cluster[2593]: {"severity":"INFO","time":"2026-08-20T08:20:12.271Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"470adb4a0bf112edbd98fd2e","created_at":"2026-08-20T08:20:12.041Z","trace_propagation_headers":{"sentry-trace":"18db10d161fe46b6ab6f2f9014d3b7dd-1daac39ce7e74eda","baggage":"sentry-trace_id=18db10d161fe46b6ab6f2f9014d3b7dd,sentry-release=Unknown"},"correlation_id":"01M0F4378EMRYN43THBDK3M5PT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:12.042Z","job_size_bytes":3,"pid":2593,"sidekiq_tid":"m839","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-470adb4a0bf112edbd98fd2e: start","job_status":"start","queue_duration_s":0.228717,"scheduling_latency_s":0.228729} gitlab # [ 254.425279] gitaly[927]: time="2026-08-20T08:20:12.732Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:12.732" grpc.time_ms=0.54 pid=927 span.kind=server system=grpc gitlab # [ 254.456629] gitaly[927]: time="2026-08-20T08:20:12.764Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:12.763" grpc.time_ms=0.394 pid=927 span.kind=server system=grpc gitlab # [ 254.465089] gitaly[927]: time="2026-08-20T08:20:12.771Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F438994NCJFSFYPAGVM3F1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:20:42.770" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:20:12.770" grpc.time_ms=0.415 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/aab18575c397c4351a711768fd911ae879f3a63c/statuses, in 0.16 seconds) gitlab # [ 254.480790] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/aab18575c397c4351a711768fd911ae879f3a63c/statuses HTTP/1.1" 200 1316 "" "curl/8.21.0" 73 (finished: subtest: eval and build post commit statuses, in 1.25 seconds) (finished: run the VM test script, in 303.94 seconds) gitlab # [ 254.494965] gitaly[927]: time="2026-08-20T08:20:12.802Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F4378EMRYN43THBDK3M5PT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:20:12.801" grpc.time_ms=0.323 pid=927 span.kind=server system=grpc test script finished in 303.96s cleanup kill QemuMachine (pid 46) gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14) (finished: cleanup, in 1.97 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T08:19:17.703Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'aab18575c397c4351a711768fd911ae879f3a63c', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T08:20:11.056605Z', 'started_at': '2026-08-20T08:20:11.353084Z', 'finished_at': None}] [{'id': 5, 'sha': 'aab18575c397c4351a711768fd911ae879f3a63c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T08:20:11.330Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'aab18575c397c4351a711768fd911ae879f3a63c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-20T08:20:11.330Z', 'started_at': None, 'finished_at': '2026-08-20T08:20:11.740Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'aab18575c397c4351a711768fd911ae879f3a63c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-20T08:20:11.898Z', 'started_at': None, 'finished_at': '2026-08-20T08:20:12.102Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]