vm-test-run-nixbot-gitlab
x86_64-linux.nixbot-gitlab
· build #157
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 13)11gitlab # Formatting '/build/vm-state-gitlab/tmp.hEcbcVVaBz', fmt=raw size=107374182412gitlab # mke2fs 1.47.3 (8-Jul-2025)13gitlab # Discarding device blocks: 0/262144 done14(finished: start all VMs, in 49.46 seconds)15gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes16gitlab: waiting for unit setup-gitlab.service17gitlab # Filesystem UUID: 3ba26c5e-13cf-444d-ab49-b43e0b693ad318gitlab: waiting for the VM to finish booting19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Jun 1 15:51:08 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/m5k6pwan99vghnaqmcdq04iyhmljrcba-nixos-system-gitlab-test/init regInfo=/nix/store/48s77fskvjaxzx83njdd01bpd0i1fagj-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 503512868 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000004] tsc: Detected 2400.006 MHz processor67gitlab # [ 0.000809] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000878] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002733] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002745] Using GB pages for direct mapping73gitlab # [ 0.002883] RAMDISK: [mem 0xbe4e0000-0xbffcffff]74gitlab # [ 0.002892] ACPI: Early table checksum verification disabled75gitlab # [ 0.002895] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002899] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002902] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002909] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002911] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002913] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002914] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002916] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002917] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002918] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002919] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002919] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002920] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002920] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003158] No NUMA configuration found90gitlab # [ 0.003159] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003161] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.006228] Zone ranges:93gitlab # [ 0.006229] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.006230] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.006232] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.006233] Device empty97gitlab # [ 0.006233] Movable zone start for each node98gitlab # [ 0.006234] Early memory node ranges99gitlab # [ 0.006234] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.006235] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.006236] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.006237] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.006259] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.006541] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.122025] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.122463] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.122479] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.122514] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.122518] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.122519] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.122521] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.122522] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.122523] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.122525] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.122527] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.122531] TSC deadline timer available117gitlab # [ 0.122536] CPU topo: Max. logical packages: 1118gitlab # [ 0.122537] CPU topo: Max. logical dies: 1119gitlab # [ 0.122537] CPU topo: Max. dies per package: 1120gitlab # [ 0.122541] CPU topo: Max. threads per core: 1121gitlab # [ 0.122541] CPU topo: Num. cores per package: 4122gitlab # [ 0.122542] CPU topo: Num. threads per package: 4123gitlab # [ 0.122542] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.122572] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.122589] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.122592] kvm-guest: setup PV sched yield127gitlab # [ 0.122608] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.122610] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.122611] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.122612] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.122614] Booting paravirtualized kernel on KVM132gitlab # [ 0.122618] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.127088] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.129438] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.129491] kvm-guest: PV spinlocks enabled136gitlab # [ 0.129492] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.129495] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/m5k6pwan99vghnaqmcdq04iyhmljrcba-nixos-system-gitlab-test/init regInfo=/nix/store/48s77fskvjaxzx83njdd01bpd0i1fagj-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.129600] Unknown kernel command line parameters "regInfo=/nix/store/48s77fskvjaxzx83njdd01bpd0i1fagj-closure-info/registration", will be passed to user space.139gitlab # [ 0.129613] random: crng init done140gitlab # [ 0.129614] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.139174] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.144123] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.144207] software IO TLB: area num 4.144gitlab # [ 0.224844] Fallback order for Node 0: 0145gitlab # [ 0.224853] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.224854] Policy zone: Normal147gitlab # [ 0.227542] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.237952] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.246952] allocated 12582912 bytes of page_ext150gitlab # [ 0.257138] ftrace: allocating 48565 entries in 192 pages151gitlab # [ 0.257139] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.258038] Dynamic Preempt: lazy153gitlab # [ 0.258202] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.258203] rcu: RCU event tracing is enabled.155gitlab # [ 0.258204] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.258205] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.258206] Rude variant of Tasks RCU enabled.158gitlab # [ 0.258206] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.258207] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.258208] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.258229] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.258230] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.258231] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.262652] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.262954] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.263080] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)167gitlab # [ 0.266696] Console: colour VGA+ 80x25168gitlab # [ 0.266699] printk: legacy console [tty0] enabled169gitlab # [ 0.297279] printk: legacy console [ttyS0] enabled170gitlab # [ 0.398571] ACPI: Core revision 20250807171gitlab # [ 0.399529] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns172gitlab # [ 0.401080] APIC: Switch to symmetric I/O mode setup173gitlab # [ 0.402096] x2apic enabled174gitlab # [ 0.402876] APIC: Switched APIC routing to: physical x2apic175gitlab # [ 0.403816] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()176gitlab # [ 0.405017] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()177gitlab # [ 0.406508] kvm-guest: setup PV IPIs178gitlab # [ 0.408114] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1179gitlab # [ 0.409144] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983d4fda2, max_idle_ns: 440795302975 ns180gitlab # [ 0.410882] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400006)181gitlab # [ 0.412966] x86/cpu: User Mode Instruction Prevention (UMIP) activated182gitlab # [ 0.414066] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127183gitlab # [ 0.414879] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0184gitlab # [ 0.415882] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto185gitlab # [ 0.417879] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl186gitlab # [ 0.419879] Transient Scheduler Attacks: Vulnerable: No microcode187gitlab # [ 0.420877] Spectre V2 : Mitigation: Enhanced / Automatic IBRS188gitlab # [ 0.421878] Speculative Return Stack Overflow: Mitigation: Safe RET189gitlab # [ 0.422878] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization190gitlab # [ 0.423884] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier191gitlab # [ 0.425879] active return thunk: srso_alias_return_thunk192gitlab # [ 0.426900] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'193gitlab # [ 0.427878] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'194gitlab # [ 0.428878] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'195gitlab # [ 0.429878] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'196gitlab # [ 0.431683] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'197gitlab # [ 0.432711] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'198gitlab # [ 0.433707] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'199gitlab # [ 0.434879] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256200gitlab # [ 0.435878] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64201gitlab # [ 0.436878] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512202gitlab # [ 0.437878] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024203gitlab # [ 0.438878] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8204gitlab # [ 0.439878] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.205gitlab # [ 0.469173] Freeing SMP alternatives memory: 44K206gitlab # [ 0.469882] pid_max: default: 32768 minimum: 301207gitlab # [ 0.470918] LSM: initializing lsm=capability,landlock,yama,bpf,ima208gitlab # [ 0.471981] landlock: Up and running.209gitlab # [ 0.472625] Yama: becoming mindful.210gitlab # [ 0.473524] LSM support for eBPF active211gitlab # [ 0.474108] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)212gitlab # [ 0.475998] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)213gitlab # [ 0.479029] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)214gitlab # [ 0.480533] Performance Events: Fam17h+ core perfctr, AMD PMU driver.215gitlab # [ 0.480888] ... version: 2216gitlab # [ 0.481642] ... bit width: 48217gitlab # [ 0.481881] ... generic counters: 6218gitlab # [ 0.482634] ... generic bitmap: 000000000000003f219gitlab # [ 0.482881] ... fixed-purpose counters: 0220gitlab # [ 0.483629] ... fixed-purpose bitmap: 0000000000000000221gitlab # [ 0.483880] ... value mask: 0000ffffffffffff222gitlab # [ 0.484817] ... max period: 00007fffffffffff223gitlab # [ 0.485599] ... global_ctrl mask: 000000000000003f224gitlab # [ 0.486004] signal: max sigframe size: 3376225gitlab # [ 0.486801] rcu: Hierarchical SRCU implementation.226gitlab # [ 0.487480] rcu: Max phase no-delay instances is 400.227gitlab # [ 0.488079] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level228gitlab # [ 0.493413] smp: Bringing up secondary CPUs ...229gitlab # [ 0.494301] smpboot: x86: Booting SMP configuration:230gitlab # [ 0.494884] .... node #0, CPUs: #1 #2 #3231gitlab # [ 0.497983] smp: Brought up 1 node, 4 CPUs232gitlab # [ 0.499629] smpboot: Total of 4 processors activated (19200.04 BogoMIPS)233gitlab # [ 0.501012] Memory: 6013160K/6290904K available (17098K kernel code, 2721K rwdata, 13520K rodata, 3644K init, 3008K bss, 258292K reserved, 0K cma-reserved)234gitlab # [ 0.502882] devtmpfs: initialized235gitlab # [ 0.504054] x86/mm: Memory block size: 128MB236gitlab # [ 0.507891] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns237gitlab # [ 0.508934] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)238gitlab # [ 0.509967] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).239gitlab # [ 0.510985] pinctrl core: initialized pinctrl subsystem240gitlab # [ 0.512218] PM: RTC time: 09:16:47, date: 2026-07-25241gitlab # [ 0.515975] NET: Registered PF_NETLINK/PF_ROUTE protocol family242gitlab # [ 0.518287] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations243gitlab # [ 0.518947] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations244gitlab # [ 0.521087] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations245gitlab # [ 0.521893] audit: initializing netlink subsys (disabled)246gitlab # [ 0.522944] audit: type=2000 audit(1784971007.467:1): state=initialized audit_enabled=0 res=1247gitlab # [ 0.523196] thermal_sys: Registered thermal governor 'fair_share'248gitlab # [ 0.524881] thermal_sys: Registered thermal governor 'bang_bang'249gitlab # [ 0.525881] thermal_sys: Registered thermal governor 'step_wise'250gitlab # [ 0.526881] thermal_sys: Registered thermal governor 'user_space'251gitlab # [ 0.527874] thermal_sys: Registered thermal governor 'power_allocator'252gitlab # [ 0.528899] cpuidle: using governor menu253gitlab # [ 0.531104] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5254gitlab # [ 0.532123] PCI: Using configuration type 1 for base access255gitlab # [ 0.532882] PCI: Using configuration type 1 for extended access256gitlab # [ 0.534076] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.257gitlab # [ 0.540022] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages258gitlab # [ 0.542887] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page259gitlab # [ 0.544888] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages260gitlab # [ 0.547886] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page261gitlab # [ 0.555877] ACPI: Added _OSI(Module Device)262gitlab # [ 0.557890] ACPI: Added _OSI(Processor Device)263gitlab # [ 0.559889] ACPI: Added _OSI(Processor Aggregator Device)264gitlab # [ 0.566640] ACPI: 1 ACPI AML tables successfully acquired and loaded265gitlab # [ 0.574030] ACPI: Interpreter enabled266gitlab # [ 0.574871] ACPI: PM: (supports S0 S3 S4 S5)267gitlab # [ 0.575421] ACPI: Using IOAPIC for interrupt routing268gitlab # [ 0.575916] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug269gitlab # [ 0.576888] PCI: Using E820 reservations for host bridge windows270gitlab # [ 0.579635] ACPI: Enabled 2 GPEs in block 00 to 0F271gitlab # [ 0.594049] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])272gitlab # [ 0.596898] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]273gitlab # [ 0.602224] acpiphp: Slot [3] registered274gitlab # [ 0.604000] acpiphp: Slot [4] registered275gitlab # [ 0.604985] acpiphp: Slot [5] registered276gitlab # [ 0.606994] acpiphp: Slot [6] registered277gitlab # [ 0.608997] acpiphp: Slot [7] registered278gitlab # [ 0.610988] acpiphp: Slot [8] registered279gitlab # [ 0.612982] acpiphp: Slot [9] registered280gitlab # [ 0.613997] acpiphp: Slot [10] registered281gitlab # [ 0.616008] acpiphp: Slot [11] registered282gitlab # [ 0.617970] acpiphp: Slot [12] registered283gitlab # [ 0.618955] acpiphp: Slot [13] registered284gitlab # [ 0.620941] acpiphp: Slot [14] registered285gitlab # [ 0.621926] acpiphp: Slot [15] registered286gitlab # [ 0.623923] acpiphp: Slot [16] registered287gitlab # [ 0.624923] acpiphp: Slot [17] registered288gitlab # [ 0.626950] acpiphp: Slot [18] registered289gitlab # [ 0.627926] acpiphp: Slot [19] registered290gitlab # [ 0.628933] acpiphp: Slot [20] registered291gitlab # [ 0.630923] acpiphp: Slot [21] registered292gitlab # [ 0.631944] acpiphp: Slot [22] registered293gitlab # [ 0.633929] acpiphp: Slot [23] registered294gitlab # [ 0.634922] acpiphp: Slot [24] registered295gitlab # [ 0.635895] acpiphp: Slot [25] registered296gitlab # [ 0.636634] acpiphp: Slot [26] registered297gitlab # [ 0.637901] acpiphp: Slot [27] registered298gitlab # [ 0.638636] acpiphp: Slot [28] registered299gitlab # [ 0.638937] acpiphp: Slot [29] registered300gitlab # [ 0.639644] acpiphp: Slot [30] registered301gitlab # [ 0.639901] acpiphp: Slot [31] registered302gitlab # [ 0.641092] PCI host bridge to bus 0000:00303gitlab # [ 0.642902] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]304gitlab # [ 0.645889] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]305gitlab # [ 0.648887] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]306gitlab # [ 0.651888] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]307gitlab # [ 0.654888] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]308gitlab # [ 0.657888] pci_bus 0000:00: root bus resource [bus 00-ff]309gitlab # [ 0.660565] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint310gitlab # [ 0.665050] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint311gitlab # [ 0.670030] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint312gitlab # [ 0.677959] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]313gitlab # [ 0.679955] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk314gitlab # [ 0.682897] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk315gitlab # [ 0.684886] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk316gitlab # [ 0.688886] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk317gitlab # [ 0.691329] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint318gitlab # [ 0.697571] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]319gitlab # [ 0.702030] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint320gitlab # [ 0.705434] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI321gitlab # [ 0.707897] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB322gitlab # [ 0.710505] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint323gitlab # [ 0.725972] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]324gitlab # [ 0.727893] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]325gitlab # [ 0.728868] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]326gitlab # [ 0.729924] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]327gitlab # [ 0.731580] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint328gitlab # [ 0.736920] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]329gitlab # [ 0.738893] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]330gitlab # [ 0.739876] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]331gitlab # [ 0.752848] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]332gitlab # [ 0.756604] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint333gitlab # [ 0.760919] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]334gitlab # [ 0.761819] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]335gitlab # [ 0.762665] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]336gitlab # [ 0.765180] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint337gitlab # [ 0.770917] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]338gitlab # [ 0.771826] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]339gitlab # [ 0.772662] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]340gitlab # [ 0.775195] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint341gitlab # [ 0.781883] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]342gitlab # [ 0.782838] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]343gitlab # [ 0.783941] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]344gitlab # [ 0.790511] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint345gitlab # [ 0.802908] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]346gitlab # [ 0.804904] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]347gitlab # [ 0.807941] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]348gitlab # [ 0.814458] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint349gitlab # [ 0.825917] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]350gitlab # [ 0.827897] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]351gitlab # [ 0.829928] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]352gitlab # [ 0.835437] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint353gitlab # [ 0.842892] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]354gitlab # [ 0.844905] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]355gitlab # [ 0.846941] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]356gitlab # [ 0.850901] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]357gitlab # [ 0.856459] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint358gitlab # [ 0.863918] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]359gitlab # [ 0.866941] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]360gitlab # [ 0.873498] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint361gitlab # [ 0.884157] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]362gitlab # [ 0.886903] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]363gitlab # [ 0.888941] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]364gitlab # [ 0.895248] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint365gitlab # [ 0.903908] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]366gitlab # [ 0.905897] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]367gitlab # [ 0.906930] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]368gitlab # [ 0.914676] ACPI: PCI: Interrupt link LNKA configured for IRQ 10369gitlab # [ 0.915824] ACPI: PCI: Interrupt link LNKB configured for IRQ 10370gitlab # [ 0.916866] ACPI: PCI: Interrupt link LNKC configured for IRQ 11371gitlab # [ 0.917793] ACPI: PCI: Interrupt link LNKD configured for IRQ 11372gitlab # [ 0.918701] ACPI: PCI: Interrupt link LNKS configured for IRQ 9373gitlab # [ 0.922285] iommu: Default domain type: Translated374gitlab # [ 0.922488] iommu: DMA domain TLB invalidation policy: lazy mode375gitlab # [ 0.924153] ACPI: bus type USB registered376gitlab # [ 0.924965] usbcore: registered new interface driver usbfs377gitlab # [ 0.925965] usbcore: registered new interface driver hub378gitlab # [ 0.926890] usbcore: registered new device driver usb379gitlab # [ 0.929123] NetLabel: Initializing380gitlab # [ 0.929747] NetLabel: domain hash size = 128381gitlab # [ 0.930430] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO382gitlab # [ 0.931959] NetLabel: unlabeled traffic allowed by default383gitlab # [ 0.932892] PCI: Using ACPI for IRQ routing384gitlab # [ 0.934163] pci 0000:00:02.0: vgaarb: setting as boot VGA device385gitlab # [ 0.934877] pci 0000:00:02.0: vgaarb: bridge control possible386gitlab # [ 0.934877] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none387gitlab # [ 0.937884] vgaarb: loaded388gitlab # [ 0.938650] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0389gitlab # [ 0.938881] hpet0: 3 comparators, 64-bit 100.000000 MHz counter390gitlab # [ 0.942958] clocksource: Switched to clocksource kvm-clock391gitlab # [ 0.948183] VFS: Disk quotas dquot_6.6.0392gitlab # [ 0.948991] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)393gitlab # [ 0.950613] pnp: PnP ACPI init394gitlab # [ 0.951736] pnp: PnP ACPI: found 6 devices395gitlab # [ 0.961286] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns396gitlab # [ 0.962897] clocksource: Switched to clocksource acpi_pm397gitlab # [ 0.963910] NET: Registered PF_INET protocol family398gitlab # [ 0.966242] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)399gitlab # [ 0.984762] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)400gitlab # [ 0.986308] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)401gitlab # [ 0.987709] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)402gitlab # [ 0.991552] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)403gitlab # [ 0.992995] TCP: Hash tables configured (established 65536 bind 65536)404gitlab # [ 0.994205] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)405gitlab # [ 0.995503] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)406gitlab # [ 0.996961] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.998347] NET: Registered PF_UNIX/PF_LOCAL protocol family408gitlab # [ 0.999311] NET: Registered PF_XDP protocol family409gitlab # [ 1.000176] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]410gitlab # [ 1.001289] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]411gitlab # [ 1.002310] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]412gitlab # [ 1.003450] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]413gitlab # [ 1.004626] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]414gitlab # [ 1.006068] pci 0000:00:01.0: PIIX3: Enabling Passive Release415gitlab # [ 1.007069] pci 0000:00:00.0: Limiting direct PCI/PCI transfers416gitlab # [ 1.009473] ACPI: \_SB_.LNKD: Enabled at IRQ 11417gitlab # [ 1.012645] PCI: CLS 0 bytes, default 64418gitlab # [ 1.013442] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)419gitlab # [ 1.013893] Trying to unpack rootfs image as initramfs...420gitlab # [ 1.014559] software IO TLB: mapped [mem 0x00000000ba4e0000-0x00000000be4e0000] (64MB)421gitlab # [ 1.014687] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983d4fda2, max_idle_ns: 440795302975 ns422gitlab # [ 1.037767] Initialise system trusted keyrings423gitlab # [ 1.039055] workingset: timestamp_bits=40 max_order=21 bucket_order=0424gitlab # [ 1.050517] Key type asymmetric registered425gitlab # [ 1.051264] Asymmetric key parser 'x509' registered426gitlab # [ 1.052211] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)427gitlab # [ 1.054088] io scheduler mq-deadline registered428gitlab # [ 1.054954] io scheduler kyber registered429gitlab # [ 1.059609] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled430gitlab # [ 1.060995] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A431gitlab # [ 1.063399] Linux agpgart interface v0.103432gitlab # [ 1.064187] ACPI: bus type drm_connector registered433gitlab # [ 1.066581] usbcore: registered new interface driver usbserial_generic434gitlab # [ 1.067696] usbserial: USB Serial support registered for generic435gitlab # [ 1.068714] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.436gitlab # [ 1.068714] Please enable it if your BIOS has the CPPC option.437gitlab # [ 1.071017] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled438gitlab # [ 1.072418] drop_monitor: Initializing network drop monitor service439gitlab # [ 1.073619] NET: Registered PF_INET6 protocol family440gitlab # [ 1.075531] Segment Routing with IPv6441gitlab # [ 1.076226] In-situ OAM (IOAM) with IPv6442gitlab # [ 1.078411] IPI shorthand broadcast: enabled443gitlab # [ 1.082739] sched_clock: Marking stable (942014742, 139914440)->(1105536996, -23607814)444gitlab # [ 1.084671] registered taskstats version 1445gitlab # [ 1.085723] Loading compiled-in X.509 certificates446gitlab # [ 1.095637] Demotion targets for Node 0: null447gitlab # [ 1.096714] Key type .fscrypt registered448gitlab # [ 1.097427] Key type fscrypt-provisioning registered449gitlab # [ 1.098416] ima: No TPM chip found, activating TPM-bypass!450gitlab # [ 1.099347] ima: Allocated hash algorithm: sha1451gitlab # [ 1.100166] ima: No architecture policies found452gitlab # [ 1.101821] PM: Magic number: 2:558:273453gitlab # [ 1.102597] tty tty10: hash matches454gitlab # [ 1.103235] net lo: hash matches455gitlab # [ 1.104806] RAS: Correctable Errors collector initialized.456gitlab # [ 1.109394] clk: Disabling unused clocks457gitlab # [ 1.110116] PM: genpd: Disabling unused power domains458gitlab # [ 1.298802] Freeing initrd memory: 27584K459gitlab # [ 1.302473] Freeing unused decrypted memory: 2028K460gitlab # [ 1.305342] Freeing unused kernel image (initmem) memory: 3644K461gitlab # [ 1.306448] Write protecting the kernel read-only data: 32768k462gitlab # [ 1.308663] Freeing unused kernel image (text/rodata gap) memory: 1332K463gitlab # [ 1.310618] Freeing unused kernel image (rodata/data gap) memory: 816K464gitlab # [ 1.375752] x86/mm: Checked W+X mappings: passed, no W+X pages found.465gitlab # [ 1.376967] Run /init as init process466gitlab # [ 1.389277] systemd[1]: Inserted module 'autofs4'467gitlab # [ 1.410850] fuse: init (API version 7.45)468gitlab # [ 1.418996] ACPI: \_SB_.LNKC: Enabled at IRQ 10469gitlab # [ 1.426632] ACPI: \_SB_.LNKA: Enabled at IRQ 10470gitlab # [ 1.430079] ACPI: \_SB_.LNKB: Enabled at IRQ 11471gitlab # [ 1.471648] systemd[1]: Successfully made /usr/ read-only.472gitlab # [ 1.808082] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)473gitlab # [ 1.849723] systemd[1]: Detected virtualization kvm.474gitlab # [ 1.852012] systemd[1]: Detected architecture x86-64.475gitlab # [ 1.854184] systemd[1]: Running in initrd.476gitlab # [ 1.856716] systemd[1]: Initializing machine ID from random generator.477gitlab # [ 1.859570] systemd[1]: Hostname set to <gitlab>.478gitlab # [ 1.943964] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 2.061694] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 2.062974] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 2.064386] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 2.065536] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 2.067272] systemd[1]: Reached target Path Units.484gitlab # [ 2.069398] systemd[1]: Reached target Slice Units.485gitlab # [ 2.071640] systemd[1]: Reached target Swaps.486gitlab # [ 2.073708] systemd[1]: Reached target Timer Units.487gitlab # [ 2.076198] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.078996] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.081239] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.083187] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.085154] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.087025] systemd[1]: Reached target Socket Units.493gitlab # [ 2.093225] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.099404] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.111435] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.118745] systemd[1]: Starting Journal Service...497gitlab # [ 2.124104] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.125650] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki499gitlab # [ 2.135507] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.154012] systemd-journald[151]: Collecting audit messages is disabled.501gitlab # [ 2.164290] netfs: FS-Cache loaded502gitlab # [ 2.168226] systemd[1]: Finished Create List of Static Device Nodes.503gitlab # [ 2.170372] systemd[1]: modprobe@configfs.service: Deactivated successfully.504gitlab # [ 2.173820] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.505gitlab # [ 2.174258] 9pnet: Installing 9P2000 support506gitlab # [ 2.176153] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev507gitlab # [ 2.178221] systemd[1]: Finished Load Kernel Module configfs.508gitlab # [ 2.183222] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.509gitlab # [ 2.186184] systemd[1]: Finished Load Kernel Module 9pnet_virtio.510gitlab # [ 2.191189] systemd[1]: Finished Load Kernel Modules.511gitlab # [ 2.192617] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config512gitlab # [ 2.196604] systemd[1]: Starting Apply Kernel Variables...513gitlab # [ 2.199229] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...514gitlab # [ 2.208158] systemd[1]: Started Journal Service.515gitlab # [ 2.069608] systemd-modules-load[153]: Using 4 probe threads516gitlab # [ 2.070972] systemd-modules-load[153]: Inserted module 'virtio_balloon'517gitlab # [ 2.072100] systemd-modules-load[153]: Inserted module 'virtio_gpu'518gitlab # [ 2.075121] systemd-modules-load[153]: Inserted module 'dm_mod'519gitlab # [ 2.076201] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.520gitlab # [ 2.078320] systemd[1]: Finished Apply Kernel Variables.521gitlab # [ 2.083334] systemd[1]: Starting Create Static Device Nodes in /dev...522gitlab # [ 2.102262] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 2.103232] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 2.104197] systemd[1]: Reached target Local File Systems.525gitlab # [ 2.105024] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 2.106702] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 2.120950] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 2.130756] systemd-udevd[191]: Using default interface naming scheme 'v260'.529gitlab # [ 2.142519] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.176533] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.177431] systemd[1]: Reached target System Initialization.532gitlab # [ 2.178324] systemd[1]: Reached target Basic System.533gitlab # [ 2.408758] SCSI subsystem initialized534gitlab # [ 2.418323] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12535gitlab # [ 2.420743] serio: i8042 KBD port at 0x60,0x64 irq 1536gitlab # [ 2.422501] serio: i8042 AUX port at 0x60,0x64 irq 12537gitlab # [ 2.425504] uhci_hcd 0000:00:01.2: UHCI Host Controller538gitlab # [ 2.426591] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1539gitlab # [ 2.427856] uhci_hcd 0000:00:01.2: detected 2 ports540gitlab # [ 2.429037] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140541gitlab # [ 2.430417] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18542gitlab # [ 2.431891] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1543gitlab # [ 2.433039] usb usb1: Product: UHCI Host Controller544gitlab # [ 2.433792] usb usb1: Manufacturer: Linux 6.18.34 uhci_hcd545gitlab # [ 2.434688] usb usb1: SerialNumber: 0000:00:01.2546gitlab # [ 2.466900] hub 1-0:1.0: USB hub found547gitlab # [ 2.468096] hub 1-0:1.0: 2 ports detected548gitlab # [ 2.471788] virtio_blk virtio4: 4/0/0 default/read/poll queues549gitlab # [ 2.472527] scsi host0: ata_piix550gitlab # [ 2.476097] scsi host1: ata_piix551gitlab # [ 2.477483] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0552gitlab # [ 2.478844] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0553gitlab # [ 2.481371] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)554gitlab # [ 2.360573] (udev-worker)[216]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.555gitlab # [ 2.362809] (udev-worker)[216]: Network interface NamePolicy= disabled on kernel command line.556gitlab # [ 2.364504] (udev-worker)[202]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.366407] systemd[1]: Starting Virtual Cons[ 2.506312] virtio_blk virtio5: 4/0/0 default/read/poll queues558gitlab # ole Setup...559gitlab # [ 2.509642] virtio_blk virtio5: [vdb] 11467424 512-byte logical blocks (5.87 GB/5.47 GiB)560gitlab # [ 2.393653] systemd-vconsole-setup[234]: Configuration of first virtual console was skipped, ignoring remaining ones.561gitlab # [ 2.397195] systemd[1]: Finished Virtual Console Setup.562gitlab # [ 2.634384] ata2: found unknown device (class 0)563gitlab # [ 2.637517] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100564gitlab # [ 2.641857] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5565gitlab # [ 2.676735] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0566gitlab # [ 2.690060] usb 1-1: new full-speed USB device number 2 using uhci_hcd567gitlab # [ 2.558118] systemd[1]: Found device /dev/disk/by-label/nixos.568gitlab # [ 2.565670] systemd[1]: Found device /dev/disk/by-label/nix-store.569gitlab # [ 2.567725] systemd[1]: Reached target Initrd Root Device.570gitlab # [ 2.713293] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray571gitlab # [ 2.575378] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...572gitlab # [ 2.760670] cdrom: Uniform CD-ROM driver Revision: 3.20573gitlab # [ 2.624564] systemd-fsck[242]: nixos: clean, 12/65536 files, 13019/262144 blocks574gitlab # [ 2.633862] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.575gitlab # [ 2.859056] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.862208] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.864982] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.866688] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.868257] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.900191] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.914195] usbcore: registered new interface driver usbhid582gitlab # [ 2.916326] usbhid: USB HID core driver583gitlab # [ 2.926536] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.930092] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 3.024664] systemd[1]: Mounting /sysroot...586gitlab # [ 3.313185] EXT4-fs (vda): mounted filesystem 3ba26c5e-13cf-444d-ab49-b43e0b693ad3 r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.177962] systemd[1]: Mounted /sysroot.588gitlab # [ 3.180628] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.188554] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.198707] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.206502] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.213094] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.217239] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.220079] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.369625] erofs (device vdb): mounted with root inode @ nid 128.596gitlab # [ 3.231081] systemd-sysroot-fstab-check[270]: /sysroot should be mounted in the initrd, will request daemon-reload.597gitlab # [ 3.235755] systemd[1]: Mounted /sysroot/nix/.ro-store.598gitlab # [ 3.238130] systemd[1]: Mounted /sysroot/nix/.rw-store.599gitlab # [ 3.239351] systemd[1]: Mounted /sysroot/run.[ 3.379512] 9p: Installing v9fs 9p2000 file system support600gitlab # 601gitlab # [ 3.245687] systemd[1]: Starting rw-sysroot-nix-store.service...602gitlab # [ 3.247170] systemd[1]: Mounted /sysroot/tmp/shared.603gitlab # [ 3.248333] systemd[1]: Mounted /sysroot/tmp/xchg.604gitlab # [ 3.249435] systemd[1]: Reload requested from client PID 270 ('systemd-sysroot') (unit initrd-parse-etc.service)...605gitlab # [ 3.252081] systemd[1]: Reloading...606gitlab # [ 3.464834] systemd[1]: Reloading finished in 215 ms.607gitlab # [ 3.499665] systemd-sysroot-fstab-check[270]: Requesting initrd-fs.target/start/replace...608gitlab # [ 3.622684] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.625948] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.632906] systemd-sysroot-fstab-check[270]: Requesting swap.target/start/replace...611gitlab # [ 3.639247] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.641563] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.644099] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.646509] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.676906] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.680551] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 4.023939] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 4.082973] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 4.085560] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 4.092127] systemd[1]: Starting Find NixOS closure...621gitlab # [ 4.098540] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 4.124577] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 4.129325] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 4.146410] systemd[1]: Finished Find NixOS closure.625gitlab # [ 4.148525] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 4.153239] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.185934] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.188199] systemd[1]: Stopped target Basic System.629gitlab # [ 4.190097] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.191953] systemd[1]: Stopped target Path Units.631gitlab # [ 4.193654] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.196215] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.198787] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.200543] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.202322] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.204319] systemd[1]: Stopped target Swaps.637gitlab # [ 4.205965] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.207720] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.209729] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.211736] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.214278] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.215971] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.219647] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.221662] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.223583] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.225191] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.227265] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.228914] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.231429] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.238480] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.240480] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.247311] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.248894] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.250858] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.252869] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.255866] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.258320] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.262920] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.271292] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.660gitlab # [ 4.275669] systemd[1]: Finished rw-sysroot-nix-store.service.661gitlab # [ 4.282664] systemd[1]: systemd-udevd.service: Deactivated successfully.662gitlab # [ 4.287800] systemd[1]: Stopped Rule-based Manager for Device Events and Files.663gitlab # [ 4.300889] systemd[1]: initrd-cleanup.service: Deactivated successfully.664gitlab # [ 4.306152] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.665gitlab # [ 4.315622] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.318128] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.326432] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.328333] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.330854] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.332952] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.335585] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.340871] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.343312] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.373431] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.376286] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.383445] systemd[1]: Reached target Switch Root.677gitlab # [ 4.388390] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.534198] initrd-nixos-activation-start[569]: booting system configuration /nix/store/m5k6pwan99vghnaqmcdq04iyhmljrcba-nixos-system-gitlab-test679gitlab # [ 4.580485] initrd-nixos-activation-start[569]: running activation script...680gitlab # [ 4.816313] initrd-nixos-activation-start[592]: setting up /etc...681gitlab # [ 4.941200] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.946782] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.958436] systemd[1]: Starting Switch Root...684gitlab # [ 4.991770] systemd[1]: Switching root.685gitlab # [ 5.464209] systemd-journald[151]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 5.615809] NET: Registered PF_VSOCK protocol family687gitlab # [ 6.002519] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 6.013072] systemd[1]: Detected virtualization kvm.689gitlab # [ 6.014972] systemd[1]: Detected architecture x86-64.690gitlab # [ 6.017063] systemd[1]: Detected first boot.691gitlab # [ 6.019732] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 6.176980] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 6.248932] systemd[1]: Applying preset policy.694gitlab # [ 6.412638] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 6.531393] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 6.532990] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 6.535048] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 6.537153] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 6.538578] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 6.540076] systemd[1]: Created slice User and Session Slice.701gitlab # [ 6.541063] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 6.542296] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 6.543410] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 6.544190] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 6.545178] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 6.546074] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 6.546813] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 6.547650] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 6.548566] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 6.549508] systemd[1]: Reached target Path Units.711gitlab # [ 6.550252] systemd[1]: Reached target Remote File Systems.712gitlab # [ 6.551106] systemd[1]: Reached target Slice Units.713gitlab # [ 6.551814] systemd[1]: Reached target Swaps.714gitlab # [ 6.553507] systemd[1]: Listening on Process Core Dump Socket.715gitlab # [ 6.554846] systemd[1]: Listening on Credential Encryption/Decryption.716gitlab # [ 6.557361] systemd[1]: Starting Journal Log Access Socket...717gitlab # [ 6.558659] systemd[1]: Listening on Journal Audit Socket.718gitlab # [ 6.559781] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.719gitlab # [ 6.561006] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki720gitlab # [ 6.562466] systemd[1]: Listening on udev Control Socket.721gitlab # [ 6.566115] systemd[1]: Mounting Huge Pages File System...722gitlab # [ 6.568157] systemd[1]: Mounting POSIX Message Queue File System...723gitlab # [ 6.570251] systemd[1]: Mounting Kernel Debug File System...724gitlab # [ 6.572177] systemd[1]: Mounting Kernel Trace File System...725gitlab # [ 6.580819] systemd[1]: Starting Create List of Static Device Nodes...726gitlab # [ 6.582001] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio727gitlab # [ 6.585748] systemd[1]: Starting Load Kernel Module configfs...728gitlab # [ 6.586707] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm729gitlab # [ 6.588327] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore730gitlab # [ 6.590254] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse731gitlab # [ 6.591460] systemd[1]: Mounting FUSE Control File System...732gitlab # [ 6.595084] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67733gitlab # [ 6.600017] systemd[1]: Starting Journal Service...734gitlab # [ 6.603827] systemd[1]: Starting Load Kernel Modules...735gitlab # [ 6.618186] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...736gitlab # [ 6.632779] systemd[1]: Starting Remount Root and Kernel File Systems...737gitlab # [ 6.635820] loop: module loaded738gitlab # [ 6.638226] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki739gitlab # [ 6.643064] systemd[1]: Starting Coldplug All udev Devices...740gitlab # [ 6.645391] systemd-journald[786]: Collecting audit messages is enabled.741gitlab # [ 6.659158] systemd[1]: Listening on Journal Log Access Socket.742gitlab # [ 6.659283] systemd[1]: Mounted Huge Pages File System.743gitlab # [ 6.659427] systemd[1]: Mounted POSIX Message Queue File System.744gitlab # [ 6.659583] systemd[1]: Mounted Kernel Debug File System.745gitlab # [ 6.659717] systemd[1]: Mounted Kernel Trace File System.746gitlab # [ 6.660286] systemd[1]: Finished Create List of Static Device Nodes.747gitlab # [ 6.665887] systemd[1]: modprobe@configfs.service: Deactivated successfully.748gitlab # [ 6.667504] systemd[1]: Finished Load Kernel Module configfs.749gitlab # [ 6.668670] systemd[1]: Mounted FUSE Control File System.750gitlab # [ 6.669031] EXT4-fs (vda): re-mounted 3ba26c5e-13cf-444d-ab49-b43e0b693ad3.751gitlab # [ 6.670139] systemd[1]: Finished Load Kernel Modules.752gitlab # [ 6.532965] systemd[1]: Queue[ 6.672768] systemd[1]: Finished Remount Root and Kernel File Systems.753gitlab # d start job for default target Multi-User System.754gitlab # [ 6.674400] systemd[1]: Started Journal Service.755gitlab # [ 6.535148] systemd[1]: Unnecessary job was removed for /dev/vdb.756gitlab # [ 6.536423] systemd[1]: systemd-journald.service: Deactivated successfully.757gitlab # [ 6.537672] systemd-modules-load[787]: Using 3 probe threads758gitlab # [ 6.538645] systemd-modules-load[787]: Inserted module 'tls'759gitlab # [ 6.539592] systemd-modules-load[787]: Inserted module 'loop'760gitlab # [ 6.540647] systemd[1]: Mounting Kernel Configuration File System...761gitlab # [ 6.541690] systemd[1]: Starting Firewall...762gitlab # [ 6.542472] systemd[1]: Starting Flush Journal to Persistent Storage...763gitlab # [ 6.543601] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore764gitlab # [ 6.545260] systemd[1]: Starting Load/Save OS Random Seed...765gitlab # [ 6.546222] systemd[1]: Starting Apply Kernel Variables...766gitlab # [ 6.552134] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...767gitlab # [ 6.553512] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki768gitlab # [ 6.562141] systemd-oomd[788]: No swap; memory pressure usage will be degraded769gitlab # [ 6.563665] systemd[1]: Mounted Kernel Configuration File System.770gitlab # [ 6.565145] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.771gitlab # [ 6.570773] systemd[1]: Finished Load/Save OS Random Seed.772gitlab # [ 6.571747] systemd[1]: Reached target First Boot Complete.773gitlab # [ 6.716178] systemd-journald[786]: Received client request to flush runtime journal.774gitlab # [ 6.625876] systemd[1]: Finished Apply Kernel Variables.775gitlab # [ 6.626989] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.776gitlab # [ 6.628351] systemd[1]: Starting Create Static Device Nodes in /dev...777gitlab # [ 6.629683] systemd[1]: Finished Create Static Device Nodes in /dev.778gitlab # [ 6.632327] systemd[1]: Reached target Preparation for Local File Systems.779gitlab # [ 6.633431] systemd[1]: Starting Rule-based Manager for Device Events and Files...780gitlab # [ 6.634533] systemd[1]: Finished Flush Journal to Persistent Storage.781gitlab # [ 6.664499] systemd-udevd[829]: Using default interface naming scheme 'v260'.782gitlab # [ 6.693674] systemd[1]: Finished Coldplug All udev Devices.783gitlab # [ 6.704498] systemd[1]: Started Rule-based Manager for Device Events and Files.784gitlab # [ 6.784315] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse785gitlab # [ 6.789927] systemd[1]: Finished Firewall.786gitlab # [ 6.799846] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.787gitlab # [ 6.804735] (udev-worker)[912]: Network interface NamePolicy= disabled on kernel command line.788gitlab # [ 6.812903] (udev-worker)[927]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.789gitlab # [ 6.815429] (udev-worker)[927]: Network interface NamePolicy= disabled on kernel command line.790gitlab # [ 6.821963] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.791gitlab # [ 6.826087] systemd[1]: Condition check resulted in Virtio network device being skipped.792gitlab # [ 6.827297] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore793gitlab # [ 6.828763] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67794gitlab # [ 6.830822] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore795gitlab # [ 6.832480] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki796gitlab # [ 6.833762] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki797gitlab # [ 7.002690] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3798gitlab # [ 7.010207] ACPI: button: Power Button [PWRF]799gitlab # [ 7.017845] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console800gitlab # [ 7.030825] Console: switching to colour dummy device 80x25801gitlab # [ 7.031686] [drm] Found bochs VGA, ID 0xb0c5.802gitlab # [ 7.031687] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.803gitlab # [ 7.033356] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic804gitlab # [ 7.033523] rtc_cmos 00:05: RTC can wake from S4805gitlab # [ 7.034220] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0806gitlab # [ 7.034512] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0807gitlab # [ 7.036827] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD808gitlab # [ 7.038234] Floppy drive(s): fd0 is 2.88M AMI BIOS809gitlab # [ 7.047581] rtc_cmos 00:05: registered as rtc0810gitlab # [ 7.048227] fbcon: bochs-drmdrmfb (fb0) is primary device811gitlab # [ 7.052966] rtc_cmos 00:05: setting system clock to 2026-07-25T09:16:53 UTC (1784971013)812gitlab # [ 7.053583] FDC 0 is a S82078B813gitlab # [ 7.054253] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs814gitlab # [ 7.054488] parport_pc 00:03: reported by Plug and Play ACPI815gitlab # [ 7.054568] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]816gitlab # [ 7.054646] Console: switching to colour frame buffer device 160x50817gitlab # [ 7.055391] systemd-journald[786]: Time jumped backwards, rotating.818gitlab # [ 7.064228] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device819gitlab # [ 7.095400] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4820gitlab # [ 7.118569] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6821gitlab # [ 7.124351] mousedev: PS/2 mouse device common for all mice822gitlab # [ 7.128806] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5823gitlab # [ 7.021458] systemd[1]: Starting Virtual Console Setup...824gitlab # [ 7.034373] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.825gitlab # [ 7.035799] systemd[1]: Stopped Virtual Console Setup.826gitlab # [ 7.036784] systemd[1]: Starting Virtual Console Setup...827gitlab # [ 7.050376] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.828gitlab # [ 7.052955] systemd[1]: Stopped Virtual Console Setup.829gitlab # [ 7.054223] systemd[1]: Starting Virtual Console Setup...830gitlab # [ 7.240977] ppdev: user-space parallel port driver831gitlab # [ 7.260798] kvm_amd: TSC scaling supported832gitlab # [ 7.261413] kvm_amd: Nested Virtualization enabled833gitlab # [ 7.262116] kvm_amd: Nested Paging enabled834gitlab # [ 7.262708] kvm_amd: LBR virtualization supported835gitlab # [ 7.263389] kvm_amd: Virtual VMLOAD VMSAVE supported836gitlab # [ 7.264069] kvm_amd: Virtual GIF supported837gitlab # [ 7.264518] kvm_amd: Virtual NMI enabled838gitlab # [ 7.135323] systemd-vconsole-setup[959]: Configuration of first virtual console was skipped, ignoring remaining ones.839gitlab # [ 7.138021] systemd[1]: Finished Virtual Console Setup.840gitlab # [ 7.300889] EDAC MC: Ver: 3.0.0841gitlab # [ 7.396887] systemd[1]: Mounting /run/wrappers...842gitlab # [ 7.421882] systemd[1]: Mounted /run/wrappers.843gitlab # [ 7.424745] systemd[1]: Reached target Local File Systems.844gitlab # [ 7.427950] systemd[1]: Listening on Boot Loader Control Service Socket.845gitlab # [ 7.432498] systemd[1]: Starting register-nix-paths.service...846gitlab # [ 7.436565] systemd[1]: Starting Create SUID/SGID Wrappers...847gitlab # [ 7.438641] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.848gitlab # [ 7.444476] systemd[1]: Starting Save Transient machine-id to Disk...849gitlab # [ 7.450991] systemd[1]: Starting Create System Files and Directories...850gitlab # [ 7.494234] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.851gitlab # [ 7.496027] systemd[1]: Finished Save Transient machine-id to Disk.852gitlab # [ 7.497862] systemd[1]: Finished Create System Files and Directories.853gitlab # [ 7.502142] systemd[1]: Starting Rebuild Journal Catalog...854gitlab # [ 7.503848] systemd[1]: Starting Record System Boot/Shutdown in UTMP...855gitlab # [ 7.531249] systemd[1]: Finished Record System Boot/Shutdown in UTMP.856gitlab # [ 7.547531] systemd[1]: Finished Rebuild Journal Catalog.857gitlab # [ 7.549032] systemd[1]: Starting Update is Completed...858gitlab # [ 7.563511] systemd[1]: Finished Update is Completed.859gitlab # [ 7.608839] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.860gitlab # [ 7.610295] systemd[1]: Finished Create SUID/SGID Wrappers.861gitlab # [ 7.611163] systemd[1]: suid-sgid-wrappers.service: Consumed 140ms CPU time over 172ms wall clock time, 5M memory peak, 1.1M read from disk.862gitlab # [ 7.885279] systemd[1]: Finished register-nix-paths.service.863gitlab # [ 7.887774] systemd[1]: Reached target System Initialization.864gitlab # [ 7.889957] systemd[1]: Started Discard unused filesystem blocks once a week.865gitlab # [ 7.892400] systemd[1]: Started logrotate.timer.866gitlab # [ 7.893812] systemd[1]: Started Daily Cleanup of Temporary Directories.867gitlab # [ 7.895644] systemd[1]: Reached target Timer Units.868gitlab # [ 7.897369] systemd[1]: Listening on D-Bus System Message Bus Socket.869gitlab # [ 7.899466] systemd[1]: Listening on Nix Daemon Socket.870gitlab # [ 7.909915] systemd[1]: Starting nixbot CI service socket...871gitlab # [ 7.912259] systemd[1]: Listening on Hostname Service Socket.872gitlab # [ 7.914342] systemd[1]: Starting D-Bus System Message Bus...873gitlab # [ 7.916731] systemd[1]: Listening on nixbot CI service socket.874gitlab # [ 7.918783] systemd[1]: Reached target Socket Units.875gitlab # [ 7.977239] dbus-broker-launch[1049]: Looking up NSS user entry for 'systemd-timesync'...876gitlab # [ 7.981119] dbus-broker-launch[1049]: NSS returned no entry for 'systemd-timesync'877gitlab # [ 7.983983] dbus-broker-launch[1049]: Invalid user-name in /nix/store/89zj9nmrajvcy9c3c08wv0ir9ww7lgmq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"878gitlab # [ 7.989794] systemd[1]: Started D-Bus System Message Bus.879gitlab # [ 8.004829] dbus-broker-launch[1049]: Ready880gitlab # [ 8.007404] systemd[1]: Reached target Basic System.881gitlab # [ 8.009814] systemd[1]: Started backdoor.service.882gitlab # [ 8.011918] systemd[1]: Starting gitlab-config.service...883gitlab # [ 8.015897] systemd[1]: Starting Import lastlog data into lastlog2 database...884gitlab # [ 8.031281] systemd[1]: Starting Logrotate configuration check...885gitlab # [ 8.033859] systemd[1]: Starting Name Service Cache Daemon (nsncd)...886gitlab # [ 8.038583] systemd[1]: Starting Post-Boot Actions...887gitlab # [ 8.045993] logrotate[1054]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.888gitlab # [ 8.051230] logrotate[1054]: reading config file /nix/store/sn4bd2nqi3yg4r51djm9i2rmfgbwvmhb-logrotate.conf889gitlab # [ 8.054595] logrotate[1054]: note: 'monthly' overrides previously specified 'weekly'890gitlab # [ 8.058469] logrotate[1054]: Reading state from file: /var/lib/logrotate.status891gitlab # connecting to host...892gitlab # [ 8.059781] logrotate[1054]: state file /var/lib/logrotate.status does not exist893gitlab # [ 8.064176] logrotate[1054]: Allocating hash table for state file, size 64 entries894gitlab # [ 8.066358] logrotate[1054]: Handling 4 logs895gitlab # [ 8.067632] logrotate[1054]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed896gitlab: Guest shell says: b'Spawning backdoor root shell...\n'897gitlab: connected to guest root shell898gitlab # [ 8.071666] logrotate[1054]: considering log /var/log/btmp899gitlab: (connecting took 8.72 seconds)900gitlab # [ 8.076931] logrotate[1054]: Creating new state901gitlab: (finished: waiting for the VM to finish booting, in 8.72 seconds)902gitlab # [ 8.077581] logrotate[1054]: Now: 2026-07-25 09:16903gitlab # [ 8.078391] logrotate[1054]: Last rotated at 2026-07-25 09:00904gitlab # [ 8.079243] logrotate[1054]: log does not need rotating (log has already been rotated)905gitlab # [ 8.080235] logrotate[1054]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed906gitlab # [ 8.082653] logrotate[1054]: considering log /var/log/wtmp907gitlab # [ 8.083373] logrotate[1054]: Creating new state908gitlab # [ 8.083973] logrotate[1054]: Now: 2026-07-25 09:16909gitlab # [ 8.084630] logrotate[1054]: Last rotated at 2026-07-25 09:00910gitlab # [ 8.085535] logrotate[1054]: log does not need rotating (log has already been rotated)911gitlab # [ 8.085924] logrotate[1054]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed912gitlab # [ 8.086647] logrotate[1054]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1054)913gitlab # [ 8.087124] logrotate[1054]: considering log /var/gitlab/state/log/*.log914gitlab # [ 8.087615] logrotate[1054]: log /var/gitlab/state/log/*.log does not exist -- skipping915gitlab # [ 8.088231] logrotate[1054]: Creating new state916gitlab # [ 8.088720] logrotate[1054]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1054)917gitlab # [ 8.089395] logrotate[1054]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed918gitlab # [ 8.089924] logrotate[1054]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1054)919gitlab # [ 8.091605] logrotate[1054]: considering log /var/log/nginx/*.log920gitlab # [ 8.092153] logrotate[1054]: log /var/log/nginx/*.log does not exist -- skipping921gitlab # [ 8.092682] logrotate[1054]: Creating new state922gitlab # [ 8.093190] logrotate[1054]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1054)923gitlab # [ 8.093750] systemd[1]: Started Reset console on configuration changes.924gitlab # [ 8.095593] systemd[1]: Starting resolvconf update...925gitlab # [ 8.096285] systemd[1]: Finished Logrotate configuration check.926gitlab # [ 8.096947] systemd[1]: Finished Post-Boot Actions.927gitlab # [ 8.103319] systemd[1]: Started Name Service Cache Daemon (nsncd).928gitlab # [ 8.104957] systemd[1]: Reached target Host and Network Name Lookups.929gitlab # [ 8.105823] nsncd[1055]: Jul 25 09:16:54.692 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"930gitlab # [ 8.107787] systemd[1]: Reached target User and Group Name Lookups.931gitlab # [ 8.112602] systemd[1]: Starting User Login Management...932gitlab # [ 8.113842] systemd[1]: Finished Import lastlog data into lastlog2 database.933gitlab # [ 8.130124] systemd[1]: Stopped target Host and Network Name Lookups.934gitlab # [ 8.131243] systemd[1]: Stopping Host and Network Name Lookups...935gitlab # [ 8.132145] systemd[1]: Stopped target User and Group Name Lookups.936gitlab # [ 8.133128] systemd[1]: Stopping User and Group Name Lookups...937gitlab # [ 8.134067] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...938gitlab # [ 8.134952] systemd[1]: nscd.service: Deactivated successfully.939gitlab # [ 8.135933] systemd[1]: Stopped Name Service Cache Daemon (nsncd).940gitlab # [ 8.136885] systemd[1]: nscd.service: Consumed 29ms CPU time over 102ms wall clock time, 7.8M memory peak, 5.6M read from disk.941gitlab # [ 8.141064] systemd[1]: Starting Name Service Cache Daemon (nsncd)...942gitlab # [ 8.158415] systemd-logind[1104]: New seat seat0.943gitlab # [ 8.159457] systemd[1]: Started Name Service Cache Daemon (nsncd).944gitlab # [ 8.161450] nsncd[1141]: Jul 25 09:16:54.745 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"945gitlab # [ 8.164204] systemd[1]: Reached target Host and Network Name Lookups.946gitlab # [ 8.165389] systemd[1]: Reached target User and Group Name Lookups.947gitlab # [ 8.166366] systemd[1]: Finished resolvconf update.948gitlab # [ 8.167117] systemd-logind[1104]: Watching system buttons on /dev/input/event2 (Power Button)949gitlab # [ 8.168666] systemd-logind[1104]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)950gitlab # [ 8.169988] systemd-logind[1104]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)951gitlab # [ 8.171305] systemd[1]: Started User Login Management.952gitlab # [ 8.172074] systemd[1]: Reached target Preparation for Network.953gitlab # [ 8.172961] systemd[1]: Starting DHCP Client...954gitlab # [ 8.173663] systemd[1]: Starting linger-users.service...955gitlab # [ 8.174474] systemd[1]: Starting Address configuration of eth1...956gitlab # [ 8.175400] systemd[1]: Starting Extra networking commands....957gitlab # [ 8.191032] systemd[1]: linger-users.service: Deactivated successfully.958gitlab # [ 8.191800] systemd[1]: Finished linger-users.service.959gitlab # [ 8.211447] network-addresses-eth1-start[1165]: adding address 192.168.1.1/24... done960gitlab # [ 8.213797] network-addresses-eth1-start[1165]: adding address 2001:db8:1::1/64... done961gitlab # [ 8.219647] systemd[1]: Finished Address configuration of eth1.962gitlab # [ 8.239074] dhcpcd[1173]: dhcpcd-10.3.2 starting963gitlab # [ 8.242266] dhcpcd[1224]: dev: loaded udev964gitlab # [ 8.243032] systemd[1]: Finished Extra networking commands..965gitlab # [ 8.243653] systemd[1]: Reached target Network.966gitlab # [ 8.246358] systemd[1]: Starting gitlab-workhorse.service...967gitlab # [ 8.248555] systemd[1]: Starting Nginx Web Server...968gitlab # [ 8.391304] 8021q: 802.1Q VLAN Support v1.8969gitlab # [ 8.391812] 8021q: adding VLAN 0 to HW filter on device eth1970gitlab # [ 8.252862] systemd[1]: Starting PostgreSQL Server...971gitlab # [ 8.255828] systemd[1]: Starting Redis Server - redis-gitlab...972gitlab # [ 8.262264] systemd[1]: Starting Permit User Sessions...973gitlab # [ 8.268204] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.974gitlab # [ 8.281076] systemd[1]: Finished Permit User Sessions.975gitlab # [ 8.289924] systemd[1]: Started Getty on tty1.976gitlab # [ 8.290583] systemd[1]: Reached target Login Prompts.977gitlab # [ 8.476976] cfg80211: Loading compiled-in X.509 certificates for regulatory database978gitlab # [ 8.482226] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'979gitlab # [ 8.484289] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'980gitlab # [ 8.486736] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2981gitlab # [ 8.488345] cfg80211: failed to load regulatory.db982gitlab # [ 8.519138] 8021q: adding VLAN 0 to HW filter on device eth0983gitlab # [ 8.381777] dhcpcd[1224]: eth0: waiting for carrier984gitlab # [ 8.383288] dhcpcd[1224]: eth0: carrier acquired985gitlab # [ 8.388096] dhcpcd[1224]: DUID 00:01:00:01:31:f7:3b:86:52:54:00:12:34:56986gitlab # [ 8.389196] dhcpcd[1224]: eth0: IAID 00:12:34:56987gitlab # [ 8.390284] dhcpcd[1224]: eth0: adding address fe80::5054:ff:fe12:3456988gitlab # [ 8.397087] redis-server[1248]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.989gitlab # [ 8.397986] nginx-pre-start[1251]: nginx: the configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf syntax is ok990gitlab # [ 8.398725] nginx-pre-start[1251]: nginx: configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf test is successful991gitlab # [ 8.399530] redis-server[1248]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo992gitlab # [ 8.400085] redis-server[1248]: Redis version=8.8.0, bits=64, commit=00000000, modified=0, pid=1248, just started993gitlab # [ 8.400508] redis-server[1248]: Configuration loaded994gitlab # [ 8.401081] redis[1248]: monotonic clock: POSIX clock_gettime995gitlab # [ 8.401602] redis[1248]: Running mode=standalone, port=0.996gitlab # [ 8.402184] redis[1248]: Server initialized997gitlab # [ 8.402635] redis[1248]: Ready to accept connections unix998gitlab # [ 8.403171] redis[1248]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.999gitlab # [ 8.404911] systemd[1]: Started Redis Server - redis-gitlab.1000gitlab # [ 8.413149] systemd[1]: Started Nginx Web Server.1001gitlab # [ 8.414295] postgresql-pre-start[1257]: The files belonging to this database system will be owned by user "postgres".1002gitlab # [ 8.415383] postgresql-pre-start[1257]: This user must also own the server process.1003gitlab # [ 8.418450] postgresql-pre-start[1257]: The database cluster will be initialized with locale "en_US.UTF-8".1004gitlab # [ 8.419210] postgresql-pre-start[1257]: The default database encoding has accordingly been set to "UTF8".1005gitlab # [ 8.419406] postgresql-pre-start[1257]: The default text search configuration will be set to "english".1006gitlab # [ 8.419908] postgresql-pre-start[1257]: Data page checksums are disabled.1007gitlab # [ 8.420633] postgresql-pre-start[1257]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok1008gitlab # [ 8.423845] postgresql-pre-start[1257]: creating subdirectories ... ok1009gitlab # [ 8.425550] postgresql-pre-start[1257]: selecting dynamic shared memory implementation ... posix1010gitlab # [ 8.455802] postgresql-pre-start[1257]: selecting default "max_connections" ... 1001011gitlab # [ 8.486438] postgresql-pre-start[1257]: selecting default "shared_buffers" ... 128MB1012gitlab # [ 8.724198] systemd[1]: Started gitlab-workhorse.service.1013gitlab # [ 8.851039] postgresql-pre-start[1257]: selecting default time zone ... UTC1014gitlab # [ 8.853677] postgresql-pre-start[1257]: creating configuration files ... ok1015gitlab # [ 8.921568] dhcpcd[1224]: eth0: soliciting a DHCP lease1016gitlab # [ 9.075791] NET: Registered PF_PACKET protocol family1017gitlab # [ 8.944160] gitlab-workhorse[1285]: time="2026-07-25T09:16:55Z" level=info msg=Starting build_time=19700101.000000 version=18.11.41018gitlab # [ 8.945272] gitlab-workhorse[1285]: time="2026-07-25T09:16:55Z" level=info msg="Using redis/go-redis"1019gitlab # [ 8.945816] gitlab-workhorse[1285]: time="2026-07-25T09:16:55Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1020gitlab # [ 8.953043] dhcpcd[1224]: eth0: offered 10.0.2.15 from 10.0.2.21021gitlab # [ 8.959188] dhcpcd[1224]: eth0: probing address 10.0.2.15/241022gitlab # [ 9.025395] postgresql-pre-start[1257]: running bootstrap script ... ok1023gitlab # [ 9.419753] postgresql-pre-start[1257]: performing post-bootstrap initialization ... ok1024gitlab # [ 9.729157] postgresql-pre-start[1257]: syncing data to disk ... ok1025gitlab # [ 9.731232] postgresql-pre-start[1257]: initdb: warning: enabling "trust" authentication for local connections1026gitlab # [ 9.732960] postgresql-pre-start[1257]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1027gitlab # [ 9.734478] postgresql-pre-start[1257]: Success. You can now start the database server using:1028gitlab # [ 9.736078] postgresql-pre-start[1257]: pg_ctl -D /var/lib/postgresql/17 -l logfile start1029gitlab # [ 9.840138] postgres[1311]: [1311] LOG: starting PostgreSQL 17.10 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1030gitlab # [ 9.844289] postgres[1311]: [1311] LOG: listening on IPv6 address "::1", port 54321031gitlab # [ 9.846210] postgres[1311]: [1311] LOG: listening on IPv4 address "127.0.0.1", port 54321032gitlab # [ 9.854362] postgres[1311]: [1311] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1033gitlab # [ 9.868546] postgres[1318]: [1318] LOG: database system was shut down at 2026-07-25 09:16:55 GMT1034gitlab # [ 9.878587] postgres[1311]: [1311] LOG: database system is ready to accept connections1035gitlab # [ 9.887581] systemd[1]: Started PostgreSQL Server.1036gitlab # [ 9.891392] systemd[1]: Starting PostgreSQL Setup Scripts...1037gitlab # [ 10.035967] postgresql-setup-start[1334]: CREATE DATABASE1038gitlab # [ 10.066771] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1327]: mkdir -p /var/gitlab/state/home/.ssh: OK1039gitlab # [ 10.068139] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1327]: chmod 700 /var/gitlab/state/home/.ssh: OK1040gitlab # [ 10.070300] postgresql-setup-start[1339]: CREATE ROLE1041gitlab # [ 10.083500] postgresql-setup-start[1343]: ALTER DATABASE1042gitlab # [ 10.106598] postgresql-setup-start[1354]: CREATE ROLE1043gitlab # [ 10.110621] systemd[1]: Finished PostgreSQL Setup Scripts.1044gitlab # [ 10.111780] systemd[1]: Reached target PostgreSQL.1045gitlab # [ 10.114795] systemd[1]: Starting gitlab-postgresql.service...1046gitlab # [ 10.116688] systemd[1]: Finished gitlab-config.service.1047gitlab # [ 10.120753] systemd[1]: Started gitaly.service.1048gitlab # [ 10.123472] systemd[1]: Starting gitlab-db-config.service...1049gitlab # [ 10.225316] gitlab-postgresql-start[1370]: CREATE DATABASE1050gitlab # [ 10.257853] gitlab-postgresql-start[1384]: CREATE EXTENSION1051gitlab # [ 10.293267] gitlab-postgresql-start[1386]: CREATE EXTENSION1052gitlab # [ 10.295644] systemd[1]: Finished gitlab-postgresql.service.1053gitlab # [ 10.706862] gitaly[1362]: time="2026-07-25T09:16:57.292Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/2wcq0nlg508fs5wq7jnpg1lw2pib950g-gitaly.toml' and fix the errors that are printed." pid=13621054gitlab # [ 10.708346] gitaly[1362]: time="2026-07-25T09:16:57.293Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=13621055gitlab # [ 10.709293] gitaly[1362]: time="2026-07-25T09:16:57.293Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=13621056gitlab # [ 10.709951] gitaly[1362]: time="2026-07-25T09:16:57.293Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=13621057gitlab # [ 10.710645] gitaly[1362]: time="2026-07-25T09:16:57.293Z" level=info msg="Starting Gitaly" pid=1362 version=18.11.41058gitlab # [ 10.912092] gitaly[1362]: time="2026-07-25T09:16:57.498Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=204 pid=13621059gitlab # [ 10.913933] gitaly[1362]: time="2026-07-25T09:16:57.499Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=13621060gitlab # [ 10.916063] gitaly[1362]: time="2026-07-25T09:16:57.502Z" level=info msg="finished initializing command factory" duration_ms=3 pid=13621061gitlab # [ 10.916725] gitaly[1362]: time="2026-07-25T09:16:57.502Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1362/git-exec-2470935915.d/git pid=13621062gitlab # [ 10.923628] gitaly[1362]: time="2026-07-25T09:16:57.510Z" level=info msg="finished detecting git version" duration_ms=7 pid=13621063gitlab # [ 10.925525] gitaly[1362]: time="2026-07-25T09:16:57.510Z" level=info msg="using Git version" pid=1362 version=2.53.g1064gitlab # [ 10.927180] gitaly[1362]: time="2026-07-25T09:16:57.510Z" level=info msg="clearing disk cache object folder" pid=1362 storage=default1065gitlab # [ 10.928918] gitaly[1362]: time="2026-07-25T09:16:57.511Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4132524897 pid=1362 storage=default1066gitlab # [ 10.931706] gitaly[1362]: time="2026-07-25T09:16:57.511Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4132524897 pid=1362 storage=default1067gitlab # [ 10.934879] gitaly[1362]: time="2026-07-25T09:16:57.511Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=13621068gitlab # [ 10.937808] gitaly[1362]: time="2026-07-25T09:16:57.511Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=13621069gitlab # [ 10.940687] gitaly[1362]: time="2026-07-25T09:16:57.511Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4132524897 clear_duration_ms=0 pid=1362 storage=default1070gitlab # [ 10.973270] gitaly[1362]: time="2026-07-25T09:16:57.559Z" level=info msg="counting repositories" pid=13621071gitlab # [ 10.974796] gitaly[1362]: time="2026-07-25T09:16:57.560Z" level=info msg="starting to count repositories" pid=1362 storage_path=/var/gitlab/state/repositories1072gitlab # [ 10.976937] gitaly[1362]: time="2026-07-25T09:16:57.560Z" level=info msg="finished tempdir cleaner walk" pid=1362 storage=default time_ms=01073gitlab # [ 10.978810] gitaly[1362]: time="2026-07-25T09:16:57.560Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=1362 storage_path=/var/gitlab/state/repositories1074gitlab # [ 10.981464] gitaly[1362]: time="2026-07-25T09:16:57.560Z" level=info msg="completed counting all repositories" counting_duration=0 pid=13621075gitlab # [ 10.982236] gitaly[1362]: time="2026-07-25T09:16:57.560Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=13621076gitlab # [ 10.982867] gitaly[1362]: time="2026-07-25T09:16:57.560Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1362 schema=unix1077gitlab # [ 10.983505] gitaly[1362]: time="2026-07-25T09:16:57.560Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1362/sock.d/intern pid=1362 schema=unix1078gitlab # [ 10.984200] gitaly[1362]: time="2026-07-25T09:16:57.562Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=13621079gitlab # [ 10.984761] gitaly[1362]: time="2026-07-25T09:16:57.562Z" level=info msg="Started Gitaly" duration_ms=268 pid=13621080gitlab # [ 10.985186] gitaly[1362]: time="2026-07-25T09:16:57.562Z" level=info msg="maintenance: daily scheduled" pid=1362 scheduled="2026-07-25 12:00:00 +0000 UTC"1081gitlab # [ 11.253353] dhcpcd[1224]: eth0: soliciting an IPv6 router1082gitlab # [ 11.255759] dhcpcd[1224]: eth0: Router Advertisement from fe80::21083gitlab # [ 11.258173] dhcpcd[1224]: eth0: adding address fec0::5054:ff:fe12:3456/641084gitlab # [ 11.260846] dhcpcd[1224]: eth0: adding route to fec0::/641085gitlab # [ 11.262911] dhcpcd[1224]: eth0: adding default route via fe80::21086gitlab # [ 11.634702] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1366]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1087gitlab # [ 11.639947] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1366]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1088gitlab # [ 11.677362] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1366]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1089gitlab # [ 12.860718] gitaly[1362]: time="2026-07-25T09:16:59.446Z" level=info msg="License database preloaded" duration_ms=2153 pid=13621090gitlab # [ 13.711097] dhcpcd[1224]: eth0: leased 10.0.2.15 for 86400 seconds1091gitlab # [ 13.712423] dhcpcd[1224]: eth0: adding route to 10.0.2.0/241092gitlab # [ 13.713636] dhcpcd[1224]: eth0: adding default route via 10.0.2.21093gitlab # [ 13.775432] systemd[1]: Started DHCP Client.1094gitlab # [ 13.777459] systemd[1]: Reached target Network is Online.1095gitlab # [ 41.620667] postgres[1735]: [1735] ERROR: relation "feature_gates" does not exist at character 5231096gitlab # [ 41.624159] postgres[1735]: [1735] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1097gitlab # [ 41.627179] postgres[1735]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1098gitlab # [ 41.630244] postgres[1735]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1099gitlab # [ 41.633096] postgres[1735]: attidentity AS identity,1100gitlab # [ 41.635092] postgres[1735]: attgenerated as attgenerated1101gitlab # [ 41.637185] postgres[1735]: FROM pg_attribute a1102gitlab # [ 41.638879] postgres[1735]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1103gitlab # [ 41.641910] postgres[1735]: LEFT JOIN pg_type t ON a.atttypid = t.oid1104gitlab # [ 41.644177] postgres[1735]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1105gitlab # [ 41.647806] postgres[1735]: WHERE a.attrelid = '"feature_gates"'::regclass1106gitlab # [ 41.650313] postgres[1735]: AND a.attnum > 0 AND NOT a.attisdropped1107gitlab # [ 41.652491] postgres[1735]: ORDER BY a.attnum1108gitlab # [ 41.654156] postgres[1735]:1109gitlab # [ 41.823477] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1366]: W, [2026-07-25T09:17:28.409537 #1366] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1110gitlab # [ 46.912946] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1790]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1111gitlab # [ 46.917797] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1790]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1112gitlab # [ 49.006201] gitlab-workhorse[1285]: time="2026-07-25T09:17:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1113gitlab # [ 59.016635] gitlab-workhorse[1285]: time="2026-07-25T09:17:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1114gitlab # [ 61.026797] postgres[1856]: [1856] ERROR: relation "table_without_models" does not exist1115gitlab # [ 61.028798] postgres[1856]: [1856] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1116gitlab # [ 69.026327] gitlab-workhorse[1285]: time="2026-07-25T09:17:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1117gitlab # [ 74.683125] systemd[1]: Finished gitlab-db-config.service.1118gitlab # [ 74.688148] systemd[1]: Started gitlab-sidekiq.service.1119gitlab # [ 74.689782] systemd[1]: Starting gitlab.service...1120gitlab # [ 75.006264] bundle[2041]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1121gitlab # [ 75.008107] bundle[2041]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1122gitlab # [ 75.011531] bundle[2041]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1123gitlab # [ 77.748823] sidekiq-cluster[2040]: {"severity":"INFO","time":"2026-07-25T09:18:04.318Z","message":"Starting cluster with 1 processes"}1124gitlab # [ 77.838566] bundle[2041]: {"timestamp":"2026-07-25T09:18:04.404Z","pid":2041,"message":"* Enabling systemd notification integration"}1125gitlab # [ 77.839779] bundle[2041]: {"timestamp":"2026-07-25T09:18:04.424Z","pid":2041,"message":"Puma starting in cluster mode..."}1126gitlab # [ 77.840827] bundle[2041]: {"timestamp":"2026-07-25T09:18:04.424Z","pid":2041,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1127gitlab # [ 77.841971] bundle[2041]: {"timestamp":"2026-07-25T09:18:04.424Z","pid":2041,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1128gitlab # [ 77.842842] bundle[2041]: {"timestamp":"2026-07-25T09:18:04.424Z","pid":2041,"message":"* Min threads: 0"}1129gitlab # [ 77.843732] bundle[2041]: {"timestamp":"2026-07-25T09:18:04.424Z","pid":2041,"message":"* Max threads: 4"}1130gitlab # [ 77.844594] bundle[2041]: {"timestamp":"2026-07-25T09:18:04.424Z","pid":2041,"message":"* Environment: production"}1131gitlab # [ 77.845550] bundle[2041]: {"timestamp":"2026-07-25T09:18:04.424Z","pid":2041,"message":"* Master PID: 2041"}1132gitlab # [ 77.846127] bundle[2041]: {"timestamp":"2026-07-25T09:18:04.424Z","pid":2041,"message":"* Workers: 2"}1133gitlab # [ 77.846793] bundle[2041]: {"timestamp":"2026-07-25T09:18:04.425Z","pid":2041,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1134gitlab # [ 77.847757] bundle[2041]: {"timestamp":"2026-07-25T09:18:04.425Z","pid":2041,"message":"* Preloading application"}1135gitlab # [ 79.037141] gitlab-workhorse[1285]: time="2026-07-25T09:18:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1136gitlab # [ 89.038435] gitlab-workhorse[1285]: time="2026-07-25T09:18:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1137gitlab # [ 99.039835] gitlab-workhorse[1285]: time="2026-07-25T09:18:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1138gitlab # [ 100.572710] bundle[2041]: W, [2026-07-25T09:18:27.158775 #2041] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1139gitlab # [ 103.525082] sidekiq-cluster[2071]: 2026-07-25T09:18:30.111Z pid=2071 tid=ty7 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2071, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430010368}1140gitlab # [ 103.713952] sidekiq-cluster[2071]: W, [2026-07-25T09:18:30.300581 #2071] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1141gitlab # [ 103.756342] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:30.342Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1142gitlab # [ 105.621563] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.207Z","message":"GitLab reliable fetch activated!"}1143gitlab # [ 105.625551] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.207Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1144gitlab # [ 105.644563] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.231Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1145gitlab # [ 105.649874] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.233Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1146gitlab # [ 105.655214] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.236Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1147gitlab # [ 105.657369] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.238Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1148gitlab # [ 105.658992] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.240Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1149gitlab # [ 105.660229] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.245Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1150gitlab # [ 105.660956] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.246Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1151gitlab # [ 105.662544] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.248Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1152gitlab # [ 105.663774] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.249Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1153gitlab # [ 105.665314] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.251Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1154gitlab # [ 105.666482] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.252Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1155gitlab # [ 105.667984] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.254Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1156gitlab # [ 105.669860] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.256Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1157gitlab # [ 105.671498] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.258Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1158gitlab # [ 105.673235] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.260Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1159gitlab # [ 105.675371] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.262Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1160gitlab # [ 105.677363] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.264Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1161gitlab # [ 105.679663] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.266Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1162gitlab # [ 105.681738] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.268Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1163gitlab # [ 105.683633] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.270Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1164gitlab # [ 105.685570] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.272Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1165gitlab # [ 105.687517] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.274Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1166gitlab # [ 105.689325] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.275Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1167gitlab # [ 105.691187] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.277Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1168gitlab # [ 105.695828] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.282Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1169gitlab # [ 105.698993] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.285Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1170gitlab # [ 105.702763] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.289Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1171gitlab # [ 105.706279] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.293Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1172gitlab # [ 105.709658] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.296Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1173gitlab # [ 105.711554] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.298Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1174gitlab # [ 105.713396] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.300Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1175gitlab # [ 105.715197] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.302Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1176gitlab # [ 105.717111] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.303Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1177gitlab # [ 105.718846] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.305Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1178gitlab # [ 105.720745] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.307Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1179gitlab # [ 105.722207] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.309Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1180gitlab # [ 105.723694] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.310Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1181gitlab # [ 105.725437] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.312Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1182gitlab # [ 105.727056] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.313Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1183gitlab # [ 105.728473] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.315Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1184gitlab # [ 105.729924] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.316Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1185gitlab # [ 105.731539] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.318Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1186gitlab # [ 105.733062] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.319Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1187gitlab # [ 105.734624] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.321Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1188gitlab # [ 105.736088] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.322Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1189gitlab # [ 105.737958] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.324Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1190gitlab # [ 105.739643] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.326Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1191gitlab # [ 105.741121] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.327Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1192gitlab # [ 105.742748] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.329Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1193gitlab # [ 105.744555] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.331Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1194gitlab # [ 105.746392] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.333Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1195gitlab # [ 105.748191] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.335Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1196gitlab # [ 105.750156] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.337Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1197gitlab # [ 105.758755] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.345Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1198gitlab # [ 105.760772] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.347Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1199gitlab # [ 105.762563] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.349Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1200gitlab # [ 105.764300] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.351Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1201gitlab # [ 105.765898] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.352Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1202gitlab # [ 105.767845] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.354Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1203gitlab # [ 105.769266] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.356Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1204gitlab # [ 105.770809] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.357Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1205gitlab # [ 105.772505] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.359Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1206gitlab # [ 105.773908] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.360Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1207gitlab # [ 105.775913] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.362Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1208gitlab # [ 105.777914] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.364Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1209gitlab # [ 105.779672] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.366Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1210gitlab # [ 105.781746] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.368Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1211gitlab # [ 105.783271] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.370Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1212gitlab # [ 105.784809] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.371Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1213gitlab # [ 105.809038] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.395Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1214gitlab # [ 105.810511] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.397Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1215gitlab # [ 105.811905] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.398Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1216gitlab # [ 105.813287] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.400Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1217gitlab # [ 105.815336] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.402Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1218gitlab # [ 105.816723] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.403Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1219gitlab # [ 105.818751] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.405Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1220gitlab # [ 105.820240] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.407Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1221gitlab # [ 105.822281] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.409Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1222gitlab # [ 105.823733] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.410Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1223gitlab # [ 105.825124] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.411Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1224gitlab # [ 105.826995] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.413Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1225gitlab # [ 105.828390] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.415Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1226gitlab # [ 105.830298] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.417Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1227gitlab # [ 105.832670] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.418Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1228gitlab # [ 105.834135] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.420Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1229gitlab # [ 105.835735] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.422Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1230gitlab # [ 105.837672] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.424Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1231gitlab # [ 105.839391] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.426Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1232gitlab # [ 105.841393] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.428Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1233gitlab # [ 105.842744] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.429Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1234gitlab # [ 105.844919] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.431Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1235gitlab # [ 105.846307] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.433Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1236gitlab # [ 105.847631] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.434Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1237gitlab # [ 105.849514] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.436Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1238gitlab # [ 105.850857] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.437Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1239gitlab # [ 105.853228] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.440Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1240gitlab # [ 105.854990] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.441Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1241gitlab # [ 105.856751] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.443Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1242gitlab # [ 105.858153] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.445Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1243gitlab # [ 105.864847] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.451Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1244gitlab # [ 105.866658] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.453Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1245gitlab # [ 105.868085] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.454Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1246gitlab # [ 105.870223] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.457Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1247gitlab # [ 105.872468] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.459Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1248gitlab # [ 105.874132] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.460Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1249gitlab # [ 105.876232] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.463Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1250gitlab # [ 105.877594] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.464Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1251gitlab # [ 105.878959] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.465Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1252gitlab # [ 105.881198] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.468Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1253gitlab # [ 105.882858] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:32.469Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1254gitlab # [ 109.040793] gitlab-workhorse[1285]: time="2026-07-25T09:18:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1255gitlab # [ 119.049991] gitlab-workhorse[1285]: time="2026-07-25T09:18:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1256gitlab # [ 127.569143] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:54.154Z","message":"Booted Rails 7.2.3 application in production environment"}1257gitlab # [ 127.570361] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:54.156Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1258gitlab # [ 127.571432] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:54.156Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1259gitlab # [ 127.572212] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:54.156Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1260gitlab # [ 127.579078] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:54.165Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1261gitlab # [ 128.298678] bundle[2041]: {"timestamp":"2026-07-25T09:18:54.884Z","pid":2041,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1262gitlab # [ 128.300709] bundle[2041]: {"timestamp":"2026-07-25T09:18:54.884Z","pid":2041,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1263gitlab # [ 128.302214] bundle[2041]: {"timestamp":"2026-07-25T09:18:54.884Z","pid":2041,"message":"! #\u003cThread:0x00007f52145825d8 /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1264gitlab # [ 128.303307] bundle[2041]: {"timestamp":"2026-07-25T09:18:54.884Z","pid":2041,"message":"! #\u003cThread:0x00007f52147e8368 /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1265gitlab # [ 128.304757] bundle[2041]: {"timestamp":"2026-07-25T09:18:54.885Z","pid":2041,"message":"Use Ctrl-C to stop"}1266gitlab # [ 128.305727] bundle[2041]: {"timestamp":"2026-07-25T09:18:54.885Z","pid":2041,"message":"Sending status to systemd every 1.0 sec"}1267gitlab # [ 128.733724] bundle[2041]: {"timestamp":"2026-07-25T09:18:55.320Z","pid":2041,"message":"- Worker 1 (PID: 2567) booted in 0.36s, phase: 0"}1268gitlab # [ 128.737060] bundle[2041]: {"timestamp":"2026-07-25T09:18:55.323Z","pid":2041,"message":"- Worker 0 (PID: 2563) booted in 0.39s, phase: 0"}1269gitlab # [ 128.742882] systemd[1]: Started gitlab.service.1270gitlab # [ 128.744624] systemd[1]: Reached target Common target for all GitLab services..1271gitlab # [ 128.752085] systemd[1]: Starting setup-gitlab.service...1272gitlab # [ 128.772308] setup-gitlab-start[2591]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1273gitlab # [ 129.076668] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:55.662Z","message":"Cleaning working queues"}1274gitlab # [ 129.082649] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:55.668Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8515681b626a4aa6cdf99bd4","created_at":"2026-07-25T09:18:00.723Z","trace_propagation_headers":{"sentry-trace":"1922ce0ddb274918ba7ae42f6e90ea0e-4eafd03f3b3540bb","baggage":"sentry-trace_id=1922ce0ddb274918ba7ae42f6e90ea0e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"a178e30cc0af6ffcdbada5fee2b1df94","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-25T09:18:00.731Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8515681b626a4aa6cdf99bd4: start","job_status":"start","queue_duration_s":54.937193,"scheduling_latency_s":54.937281}1275gitlab # [ 129.265923] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:18:55.852Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8515681b626a4aa6cdf99bd4","created_at":"2026-07-25T09:18:00.723Z","trace_propagation_headers":{"sentry-trace":"1922ce0ddb274918ba7ae42f6e90ea0e-4eafd03f3b3540bb","baggage":"sentry-trace_id=1922ce0ddb274918ba7ae42f6e90ea0e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"a178e30cc0af6ffcdbada5fee2b1df94","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-25T09:18:00.731Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8515681b626a4aa6cdf99bd4: done: 0.184058 sec","job_status":"done","queue_duration_s":54.937193,"scheduling_latency_s":54.937281,"redis_calls":26,"redis_duration_s":0.00421,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.002115,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001247,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000848,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08167323,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.184058,"completed_at":"2026-07-25T09:18:55.852Z","load_balancing_strategy":"primary","db_duration_s":0.044629,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1276gitlab # [ 131.202118] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:18:57 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 24051277gitlab # [ 131.210324] setup-gitlab-start[2622]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1278gitlab # [ 131.212816] setup-gitlab-start[2623]: ++ jq -r .access_token1279gitlab # [ 132.207871] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:18:58 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 9801280gitlab # [ 132.215246] setup-gitlab-start[2591]: + BEARER=7b0db1e9c2c4d205fff77e9571379b988fdbb7dfdb639c29c31ebe136cb71c2e1281gitlab # [ 132.215973] setup-gitlab-start[2591]: + AUTH='Authorization: Bearer 7b0db1e9c2c4d205fff77e9571379b988fdbb7dfdb639c29c31ebe136cb71c2e'1282gitlab # [ 132.217065] setup-gitlab-start[2591]: + curl -fs -X PUT -H 'Authorization: Bearer 7b0db1e9c2c4d205fff77e9571379b988fdbb7dfdb639c29c31ebe136cb71c2e' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1283gitlab # [ 133.002195] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:18:59 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 7561284gitlab # [ 133.007681] setup-gitlab-start[2591]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1285gitlab # [ 133.025518] runuser[2643]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1286gitlab # [ 133.380644] setup-gitlab-start[2644]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1287gitlab # [ 133.385626] setup-gitlab-start[2644]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1288gitlab # [ 133.390421] setup-gitlab-start[2644]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1289gitlab # [ 133.922144] setup-gitlab-start[2644]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1290gitlab # [ 133.927140] setup-gitlab-start[2644]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1291gitlab # [ 133.931755] setup-gitlab-start[2644]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1292gitlab # [ 140.119453] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:06.704Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ec260502595f8186df6e6a6e","created_at":"2026-07-25T09:19:06.667Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84ce39ea888f8aca617d4e62a6c126c0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.701Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ec260502595f8186df6e6a6e: start","job_status":"start","queue_duration_s":0.002867,"scheduling_latency_s":0.002924}1293gitlab # [ 140.173063] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:06.759Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ec260502595f8186df6e6a6e","created_at":"2026-07-25T09:19:06.667Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84ce39ea888f8aca617d4e62a6c126c0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.701Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ec260502595f8186df6e6a6e: done: 0.054476 sec","job_status":"done","queue_duration_s":0.002867,"scheduling_latency_s":0.002924,"redis_calls":12,"redis_duration_s":0.010079999999999999,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003103,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003423,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003554,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001387886,"exclusive_lock_hold_duration_s":0.010259684000000002,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.054476,"completed_at":"2026-07-25T09:19:06.759Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 140.240889] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:06.827Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"14bd812debc3a876af641367","created_at":"2026-07-25T09:19:06.711Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1baa50a3441c998104c54c81d3e56204","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.725Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-14bd812debc3a876af641367: start","job_status":"start","queue_duration_s":0.101312,"scheduling_latency_s":0.101359}1295gitlab # [ 140.886266] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.472Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"14bd812debc3a876af641367","created_at":"2026-07-25T09:19:06.711Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1baa50a3441c998104c54c81d3e56204","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.725Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-14bd812debc3a876af641367: done: 0.645655 sec","job_status":"done","queue_duration_s":0.101312,"scheduling_latency_s":0.101359,"redis_calls":14,"redis_duration_s":0.012249,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001568,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001921,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":123,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":80,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.033,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.343276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001061308,"exclusive_lock_hold_duration_s":0.598766604,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.645655,"completed_at":"2026-07-25T09:19:07.472Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.059439,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 140.962860] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.474Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"cf970a149388dbebd9f29c96","created_at":"2026-07-25T09:19:06.736Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e264e270f286397632548aa635689a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.825Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-cf970a149388dbebd9f29c96: start","job_status":"start","queue_duration_s":0.648723,"scheduling_latency_s":0.648739}1297gitlab # [ 140.975839] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.482Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1298gitlab # [ 140.978854] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.487Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"cf970a149388dbebd9f29c96","created_at":"2026-07-25T09:19:06.736Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e264e270f286397632548aa635689a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.825Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-cf970a149388dbebd9f29c96: done: 0.01314 sec","job_status":"done","queue_duration_s":0.648723,"scheduling_latency_s":0.648739,"redis_calls":10,"redis_duration_s":0.00208,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001207,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000256737,"duration_s":0.01314,"completed_at":"2026-07-25T09:19:07.487Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 141.016644] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.488Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0792dd0773b75b331843721a","created_at":"2026-07-25T09:19:06.846Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c08d73e3e24a45f75b07d67339a7984","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-25T09:19:06.863Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0792dd0773b75b331843721a: start","job_status":"start","queue_duration_s":0.624924,"scheduling_latency_s":0.624938}1300gitlab # [ 141.029364] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.513Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0792dd0773b75b331843721a","created_at":"2026-07-25T09:19:06.846Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c08d73e3e24a45f75b07d67339a7984","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-25T09:19:06.863Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0792dd0773b75b331843721a: done: 0.024693 sec","job_status":"done","queue_duration_s":0.624924,"scheduling_latency_s":0.624938,"redis_calls":10,"redis_duration_s":0.002258,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000498,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001335,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000302273,"duration_s":0.024693,"completed_at":"2026-07-25T09:19:07.513Z","load_balancing_strategy":"primary","db_duration_s":0.005738,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 141.030451] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.514Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"565efdc8f13df30068ca4cdc","created_at":"2026-07-25T09:19:06.891Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63a4fa99b624434fb0fa48bd14ff311f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.926Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-565efdc8f13df30068ca4cdc: start","job_status":"start","queue_duration_s":0.58814,"scheduling_latency_s":0.588154}1302gitlab # [ 141.038569] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"565efdc8f13df30068ca4cdc","created_at":"2026-07-25T09:19:06.891Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63a4fa99b624434fb0fa48bd14ff311f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.926Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-565efdc8f13df30068ca4cdc: done: 0.024637 sec","job_status":"done","queue_duration_s":0.58814,"scheduling_latency_s":0.588154,"redis_calls":20,"redis_duration_s":0.004385,"redis_read_bytes":20,"redis_write_bytes":3248,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.00196,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.000322,"redis_queues_read_bytes":3,"redis_queues_write_bytes":818,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001428,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000675,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027238,"duration_s":0.024637,"completed_at":"2026-07-25T09:19:07.539Z","load_balancing_strategy":"primary","db_duration_s":0.001575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 141.076877] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"231124886a4a357e2c75e654","created_at":"2026-07-25T09:19:06.936Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4bf22fc9cdf4cb688af4505612c3720c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.946Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-231124886a4a357e2c75e654: start","job_status":"start","queue_duration_s":0.593901,"scheduling_latency_s":0.593914}1304gitlab # [ 141.116696] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.564Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"231124886a4a357e2c75e654","created_at":"2026-07-25T09:19:06.936Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4bf22fc9cdf4cb688af4505612c3720c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.946Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-231124886a4a357e2c75e654: done: 0.02406 sec","job_status":"done","queue_duration_s":0.593901,"scheduling_latency_s":0.593914,"redis_calls":13,"redis_duration_s":0.00285,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000412,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001512,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.009209829,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.02406,"completed_at":"2026-07-25T09:19:07.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004216,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1305gitlab # [ 141.127880] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.565Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ee4d3bc2eee1f59431cf328c","created_at":"2026-07-25T09:19:06.953Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22cedaa812c291d8d8c404378939651f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.960Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ee4d3bc2eee1f59431cf328c: start","job_status":"start","queue_duration_s":0.604752,"scheduling_latency_s":0.604766}1306gitlab # [ 141.166328] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ee4d3bc2eee1f59431cf328c","created_at":"2026-07-25T09:19:06.953Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22cedaa812c291d8d8c404378939651f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.960Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ee4d3bc2eee1f59431cf328c: done: 0.017109 sec","job_status":"done","queue_duration_s":0.604752,"scheduling_latency_s":0.604766,"redis_calls":10,"redis_duration_s":0.0020930000000000002,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000486,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001146,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000461,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000263442,"duration_s":0.017109,"completed_at":"2026-07-25T09:19:07.582Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 141.176612] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"155e4fee09ee5e2f3d2147e6","created_at":"2026-07-25T09:19:06.968Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cb98aa3278d86884af26c5db67dbf58","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.973Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-155e4fee09ee5e2f3d2147e6: start","job_status":"start","queue_duration_s":0.610358,"scheduling_latency_s":0.610371}1308gitlab # [ 141.189462] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.592Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1309gitlab # [ 141.192632] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.597Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"155e4fee09ee5e2f3d2147e6","created_at":"2026-07-25T09:19:06.968Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cb98aa3278d86884af26c5db67dbf58","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.973Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-155e4fee09ee5e2f3d2147e6: done: 0.013232 sec","job_status":"done","queue_duration_s":0.610358,"scheduling_latency_s":0.610371,"redis_calls":10,"redis_duration_s":0.001976,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000425,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001165,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000386,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000274616,"duration_s":0.013232,"completed_at":"2026-07-25T09:19:07.597Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 141.230764] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.598Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"1fed235835857363a7df6940","created_at":"2026-07-25T09:19:06.982Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57800f51abca9bcfb620ee7aac7067ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-25T09:19:06.988Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-1fed235835857363a7df6940: start","job_status":"start","queue_duration_s":0.609288,"scheduling_latency_s":0.6093}1311gitlab # [ 141.269127] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.606Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1312gitlab # [ 141.269534] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.611Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"1fed235835857363a7df6940","created_at":"2026-07-25T09:19:06.982Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57800f51abca9bcfb620ee7aac7067ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-25T09:19:06.988Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-1fed235835857363a7df6940: done: 0.013035 sec","job_status":"done","queue_duration_s":0.609288,"scheduling_latency_s":0.6093,"redis_calls":10,"redis_duration_s":0.002185,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000412,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001377,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000396,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000322667,"duration_s":0.013035,"completed_at":"2026-07-25T09:19:07.611Z","load_balancing_strategy":"primary","db_duration_s":0.000437,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 141.281591] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ad9379cfc733a9005fb4641a","created_at":"2026-07-25T09:19:06.991Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.996Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ad9379cfc733a9005fb4641a: start","job_status":"start","queue_duration_s":0.615978,"scheduling_latency_s":0.615991}1314gitlab # [ 141.293596] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.704Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ad9379cfc733a9005fb4641a","created_at":"2026-07-25T09:19:06.991Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:06.996Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ad9379cfc733a9005fb4641a: done: 0.092274 sec","job_status":"done","queue_duration_s":0.615978,"scheduling_latency_s":0.615991,"redis_calls":71,"redis_duration_s":0.012391000000000001,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002644,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000545,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.008311,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000254502,"duration_s":0.092274,"completed_at":"2026-07-25T09:19:07.704Z","load_balancing_strategy":"primary","db_duration_s":0.002243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 141.348824] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.705Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8b5b2a589adf08711b8d7fe2","created_at":"2026-07-25T09:19:07.008Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf11b1c763b31d22777508794bb4c9dd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.012Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8b5b2a589adf08711b8d7fe2: start","job_status":"start","queue_duration_s":0.693203,"scheduling_latency_s":0.693218}1316gitlab # [ 141.349718] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.731Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8b5b2a589adf08711b8d7fe2","created_at":"2026-07-25T09:19:07.008Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf11b1c763b31d22777508794bb4c9dd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.012Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8b5b2a589adf08711b8d7fe2: done: 0.025555 sec","job_status":"done","queue_duration_s":0.693203,"scheduling_latency_s":0.693218,"redis_calls":12,"redis_duration_s":0.00175,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000567,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00032993,"exclusive_lock_hold_duration_s":0.011817423,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.025555,"completed_at":"2026-07-25T09:19:07.731Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005282,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 141.388746] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.732Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"687bf58128292a7d42bbbde4","created_at":"2026-07-25T09:19:07.016Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbff41bb028860b73125ef383d2c036e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.020Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-687bf58128292a7d42bbbde4: start","job_status":"start","queue_duration_s":0.712061,"scheduling_latency_s":0.712075}1318gitlab # [ 141.396668] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"687bf58128292a7d42bbbde4","created_at":"2026-07-25T09:19:07.016Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbff41bb028860b73125ef383d2c036e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.020Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-687bf58128292a7d42bbbde4: done: 0.222753 sec","job_status":"done","queue_duration_s":0.712061,"scheduling_latency_s":0.712075,"redis_calls":574,"redis_duration_s":0.062969,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.061964,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.174899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222095,"duration_s":0.222753,"completed_at":"2026-07-25T09:19:07.955Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 141.460738] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.956Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c38df88c416145f511e3c1c1","created_at":"2026-07-25T09:19:07.028Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0616ff8ac786847493c2cfbd7971cdee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.033Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c38df88c416145f511e3c1c1: start","job_status":"start","queue_duration_s":0.9231,"scheduling_latency_s":0.923115}1320gitlab # [ 141.461661] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.977Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c38df88c416145f511e3c1c1","created_at":"2026-07-25T09:19:07.028Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0616ff8ac786847493c2cfbd7971cdee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.033Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c38df88c416145f511e3c1c1: done: 0.020517 sec","job_status":"done","queue_duration_s":0.9231,"scheduling_latency_s":0.923115,"redis_calls":12,"redis_duration_s":0.002087,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001035,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000235226,"duration_s":0.020517,"completed_at":"2026-07-25T09:19:07.976Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 141.487458] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b42c676d106704f09f146c42","created_at":"2026-07-25T09:19:07.041Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b89ad9537f3ed7fb238da945956be82f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.045Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b42c676d106704f09f146c42: start","job_status":"start","queue_duration_s":0.932397,"scheduling_latency_s":0.932413}1322gitlab # [ 141.500645] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.986Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1323gitlab # [ 141.541771] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b42c676d106704f09f146c42","created_at":"2026-07-25T09:19:07.041Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b89ad9537f3ed7fb238da945956be82f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.045Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b42c676d106704f09f146c42: done: 0.013262 sec","job_status":"done","queue_duration_s":0.932397,"scheduling_latency_s":0.932413,"redis_calls":10,"redis_duration_s":0.001409,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000295,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000248356,"duration_s":0.013262,"completed_at":"2026-07-25T09:19:07.991Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 141.543047] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:07.992Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c9f3b883803cad3812770775","created_at":"2026-07-25T09:19:07.050Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fbd296bec1db6199cefb06cd177d6163","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.054Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c9f3b883803cad3812770775: start","job_status":"start","queue_duration_s":0.93822,"scheduling_latency_s":0.938234}1325gitlab # [ 141.555482] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.014Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c9f3b883803cad3812770775","created_at":"2026-07-25T09:19:07.050Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fbd296bec1db6199cefb06cd177d6163","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.054Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c9f3b883803cad3812770775: done: 0.022474 sec","job_status":"done","queue_duration_s":0.93822,"scheduling_latency_s":0.938234,"redis_calls":10,"redis_duration_s":0.00145,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000427,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000230197,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.022474,"completed_at":"2026-07-25T09:19:08.014Z","load_balancing_strategy":"primary","db_duration_s":0.007913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 141.619041] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.015Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"e1a8acb38eff71d467b6ca7a","created_at":"2026-07-25T09:19:07.062Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c4331ff70ea7cb002dfc0d2ad307be8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-25T09:19:07.066Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-e1a8acb38eff71d467b6ca7a: start","job_status":"start","queue_duration_s":0.949505,"scheduling_latency_s":0.949519}1327gitlab # [ 141.619768] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.023Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1328gitlab # [ 141.620522] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.028Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"e1a8acb38eff71d467b6ca7a","created_at":"2026-07-25T09:19:07.062Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c4331ff70ea7cb002dfc0d2ad307be8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-25T09:19:07.066Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-e1a8acb38eff71d467b6ca7a: done: 0.012765 sec","job_status":"done","queue_duration_s":0.949505,"scheduling_latency_s":0.949519,"redis_calls":10,"redis_duration_s":0.00138,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195835,"duration_s":0.012765,"completed_at":"2026-07-25T09:19:08.028Z","load_balancing_strategy":"primary","db_duration_s":0.000287,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 141.647932] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.029Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"717ad13c06f3dd842d1230ff","created_at":"2026-07-25T09:19:07.069Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f9fc1e3317a1faa5997fb38e41e19a0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.072Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-717ad13c06f3dd842d1230ff: start","job_status":"start","queue_duration_s":0.956998,"scheduling_latency_s":0.957012}1330gitlab # [ 141.692983] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.053Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"717ad13c06f3dd842d1230ff","created_at":"2026-07-25T09:19:07.069Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f9fc1e3317a1faa5997fb38e41e19a0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.072Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-717ad13c06f3dd842d1230ff: done: 0.024197 sec","job_status":"done","queue_duration_s":0.956998,"scheduling_latency_s":0.957012,"redis_calls":16,"redis_duration_s":0.002141,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001058,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000305,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195277,"duration_s":0.024197,"completed_at":"2026-07-25T09:19:08.053Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 141.699152] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"13c6616b166be9379827434f","created_at":"2026-07-25T09:19:07.075Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad9b7b3830c607108fdd0c3c15b6944e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.080Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-13c6616b166be9379827434f: start","job_status":"start","queue_duration_s":0.974711,"scheduling_latency_s":0.974725}1332gitlab # [ 141.744960] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.080Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"13c6616b166be9379827434f","created_at":"2026-07-25T09:19:07.075Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad9b7b3830c607108fdd0c3c15b6944e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.080Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-13c6616b166be9379827434f: done: 0.025808 sec","job_status":"done","queue_duration_s":0.974711,"scheduling_latency_s":0.974725,"redis_calls":12,"redis_duration_s":0.001658,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00062,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00032993,"exclusive_lock_hold_duration_s":0.008305805000000001,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.025808,"completed_at":"2026-07-25T09:19:08.080Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0073,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 141.753627] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.081Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"300ccbf97e04584e0593569d","created_at":"2026-07-25T09:19:07.103Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f984aaf526893f4bdc0053de1a5eea5b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.110Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-300ccbf97e04584e0593569d: start","job_status":"start","queue_duration_s":0.971291,"scheduling_latency_s":0.971304}1334gitlab # [ 141.805759] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.094Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"300ccbf97e04584e0593569d","created_at":"2026-07-25T09:19:07.103Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f984aaf526893f4bdc0053de1a5eea5b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.110Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-300ccbf97e04584e0593569d: done: 0.012964 sec","job_status":"done","queue_duration_s":0.971291,"scheduling_latency_s":0.971304,"redis_calls":10,"redis_duration_s":0.001395,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000244,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000333,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243885,"duration_s":0.012964,"completed_at":"2026-07-25T09:19:08.094Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 141.806936] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.095Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b55bc5de95ea010e8d18100f","created_at":"2026-07-25T09:19:07.122Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5cc7cc6406572d26188fac370a2ebfd5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.128Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b55bc5de95ea010e8d18100f: start","job_status":"start","queue_duration_s":0.96684,"scheduling_latency_s":0.966853}1336gitlab # [ 141.819397] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.102Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1337gitlab # [ 141.822838] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.107Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b55bc5de95ea010e8d18100f","created_at":"2026-07-25T09:19:07.122Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5cc7cc6406572d26188fac370a2ebfd5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.128Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b55bc5de95ea010e8d18100f: done: 0.01218 sec","job_status":"done","queue_duration_s":0.96684,"scheduling_latency_s":0.966853,"redis_calls":10,"redis_duration_s":0.0012799999999999999,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196952,"duration_s":0.01218,"completed_at":"2026-07-25T09:19:08.107Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 141.889851] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.109Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f58f70b4023c5396fdc5cdb4","created_at":"2026-07-25T09:19:07.140Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"285e3d2ab4d1b6179b695156392755cb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.145Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f58f70b4023c5396fdc5cdb4: start","job_status":"start","queue_duration_s":0.963266,"scheduling_latency_s":0.963282}1339gitlab # [ 141.890649] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.125Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f58f70b4023c5396fdc5cdb4","created_at":"2026-07-25T09:19:07.140Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"285e3d2ab4d1b6179b695156392755cb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.145Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f58f70b4023c5396fdc5cdb4: done: 0.016773 sec","job_status":"done","queue_duration_s":0.963266,"scheduling_latency_s":0.963282,"redis_calls":12,"redis_duration_s":0.001726,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000629,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000330209,"exclusive_lock_hold_duration_s":0.003984025,"duration_s":0.016773,"completed_at":"2026-07-25T09:19:08.125Z","load_balancing_strategy":"primary","db_duration_s":0.001837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 141.942765] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.126Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0f0246e7ca4761eb1bdb0dd7","created_at":"2026-07-25T09:19:07.155Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10d7e1513f6e23c478462381a7cc77d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.159Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0f0246e7ca4761eb1bdb0dd7: start","job_status":"start","queue_duration_s":0.966821,"scheduling_latency_s":0.966834}1341gitlab # [ 141.943686] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.149Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0f0246e7ca4761eb1bdb0dd7","created_at":"2026-07-25T09:19:07.155Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10d7e1513f6e23c478462381a7cc77d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.159Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0f0246e7ca4761eb1bdb0dd7: done: 0.022275 sec","job_status":"done","queue_duration_s":0.966821,"scheduling_latency_s":0.966834,"redis_calls":19,"redis_duration_s":0.002406,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000212,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000391,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195276,"duration_s":0.022275,"completed_at":"2026-07-25T09:19:08.149Z","load_balancing_strategy":"primary","db_duration_s":0.001079,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 141.964570] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"bae61b84352957b5c7775146","created_at":"2026-07-25T09:19:07.526Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-08c2d2914c2847e1","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"63a4fa99b624434fb0fa48bd14ff311f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.532Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-bae61b84352957b5c7775146: start","job_status":"start","queue_duration_s":0.616893,"scheduling_latency_s":0.616906}1343gitlab # [ 141.975891] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"bae61b84352957b5c7775146","created_at":"2026-07-25T09:19:07.526Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-08c2d2914c2847e1","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"63a4fa99b624434fb0fa48bd14ff311f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.532Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-bae61b84352957b5c7775146: done: 0.02096 sec","job_status":"done","queue_duration_s":0.616893,"scheduling_latency_s":0.616906,"redis_calls":13,"redis_duration_s":0.0019820000000000003,"redis_read_bytes":12,"redis_write_bytes":1665,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000411,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041402,"duration_s":0.02096,"completed_at":"2026-07-25T09:19:08.170Z","load_balancing_strategy":"primary","db_duration_s":0.002467,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 142.012691] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f709982aa74058aa416ef26e","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f709982aa74058aa416ef26e: start","job_status":"start","queue_duration_s":0.473738,"scheduling_latency_s":0.473751}1345gitlab # [ 142.054816] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f709982aa74058aa416ef26e","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f709982aa74058aa416ef26e: done: 0.014493 sec","job_status":"done","queue_duration_s":0.473738,"scheduling_latency_s":0.473751,"redis_calls":16,"redis_duration_s":0.002328,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000388,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001255,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243327,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014493,"completed_at":"2026-07-25T09:19:08.186Z","load_balancing_strategy":"primary","db_duration_s":0.000228,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 142.060941] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e53faa8752daea75d102d67","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e53faa8752daea75d102d67: start","job_status":"start","queue_duration_s":0.48931,"scheduling_latency_s":0.489323}1347gitlab # [ 142.072582] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e53faa8752daea75d102d67","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e53faa8752daea75d102d67: done: 0.010098 sec","job_status":"done","queue_duration_s":0.48931,"scheduling_latency_s":0.489323,"redis_calls":13,"redis_duration_s":0.001683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010098,"completed_at":"2026-07-25T09:19:08.197Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 142.128179] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5729d73ccef0c2772bb62d78","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5729d73ccef0c2772bb62d78: start","job_status":"start","queue_duration_s":0.50041,"scheduling_latency_s":0.500424}1349gitlab # [ 142.128879] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5729d73ccef0c2772bb62d78","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5729d73ccef0c2772bb62d78: done: 0.010257 sec","job_status":"done","queue_duration_s":0.50041,"scheduling_latency_s":0.500424,"redis_calls":13,"redis_duration_s":0.0018080000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001203,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010257,"completed_at":"2026-07-25T09:19:08.208Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 142.155541] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8046e4e4c3f84cd1be4a33fc","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8046e4e4c3f84cd1be4a33fc: start","job_status":"start","queue_duration_s":0.511507,"scheduling_latency_s":0.511521}1351gitlab # [ 142.196946] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8046e4e4c3f84cd1be4a33fc","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8046e4e4c3f84cd1be4a33fc: done: 0.010321 sec","job_status":"done","queue_duration_s":0.511507,"scheduling_latency_s":0.511521,"redis_calls":13,"redis_duration_s":0.001688,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010321,"completed_at":"2026-07-25T09:19:08.219Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 142.202397] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84a64954760f36fbb54e8f4e","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84a64954760f36fbb54e8f4e: start","job_status":"start","queue_duration_s":0.522657,"scheduling_latency_s":0.522671}1353gitlab # [ 142.213992] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84a64954760f36fbb54e8f4e","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84a64954760f36fbb54e8f4e: done: 0.009927 sec","job_status":"done","queue_duration_s":0.522657,"scheduling_latency_s":0.522671,"redis_calls":13,"redis_duration_s":0.001558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009927,"completed_at":"2026-07-25T09:19:08.230Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 142.254083] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a7f133df243a9ded0933803","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a7f133df243a9ded0933803: start","job_status":"start","queue_duration_s":0.533476,"scheduling_latency_s":0.53349}1355gitlab # [ 142.294371] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a7f133df243a9ded0933803","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a7f133df243a9ded0933803: done: 0.009956 sec","job_status":"done","queue_duration_s":0.533476,"scheduling_latency_s":0.53349,"redis_calls":13,"redis_duration_s":0.001658,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009956,"completed_at":"2026-07-25T09:19:08.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 142.295525] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8752ecac456b185618faa186","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8752ecac456b185618faa186: start","job_status":"start","queue_duration_s":0.544267,"scheduling_latency_s":0.544281}1357gitlab # [ 142.306960] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8752ecac456b185618faa186","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8752ecac456b185618faa186: done: 0.010199 sec","job_status":"done","queue_duration_s":0.544267,"scheduling_latency_s":0.544281,"redis_calls":13,"redis_duration_s":0.00157,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010199,"completed_at":"2026-07-25T09:19:08.252Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 142.372995] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf7acc654984193d8d037bb5","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf7acc654984193d8d037bb5: start","job_status":"start","queue_duration_s":0.555331,"scheduling_latency_s":0.555344}1359gitlab # [ 142.373755] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf7acc654984193d8d037bb5","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf7acc654984193d8d037bb5: done: 0.010117 sec","job_status":"done","queue_duration_s":0.555331,"scheduling_latency_s":0.555344,"redis_calls":13,"redis_duration_s":0.0018939999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010117,"completed_at":"2026-07-25T09:19:08.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 142.390704] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5445f77e022e0b8374700dd9","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5445f77e022e0b8374700dd9: start","job_status":"start","queue_duration_s":0.566322,"scheduling_latency_s":0.566336}1361gitlab # [ 142.402152] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5445f77e022e0b8374700dd9","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5445f77e022e0b8374700dd9: done: 0.009729 sec","job_status":"done","queue_duration_s":0.566322,"scheduling_latency_s":0.566336,"redis_calls":13,"redis_duration_s":0.001715,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009729,"completed_at":"2026-07-25T09:19:08.274Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 142.470897] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3fa85f399e86966fa89bc00","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3fa85f399e86966fa89bc00: start","job_status":"start","queue_duration_s":0.577078,"scheduling_latency_s":0.577094}1363gitlab # [ 142.471605] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3fa85f399e86966fa89bc00","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3fa85f399e86966fa89bc00: done: 0.009988 sec","job_status":"done","queue_duration_s":0.577078,"scheduling_latency_s":0.577094,"redis_calls":13,"redis_duration_s":0.001677,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009988,"completed_at":"2026-07-25T09:19:08.285Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 142.485546] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"955096a9919299a3b56d335b","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-955096a9919299a3b56d335b: start","job_status":"start","queue_duration_s":0.58817,"scheduling_latency_s":0.588184}1365gitlab # [ 142.496981] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"955096a9919299a3b56d335b","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-955096a9919299a3b56d335b: done: 0.009924 sec","job_status":"done","queue_duration_s":0.58817,"scheduling_latency_s":0.588184,"redis_calls":13,"redis_duration_s":0.001637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001131,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009924,"completed_at":"2026-07-25T09:19:08.296Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 142.554841] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88fdd5b7bd70705b82b701cf","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88fdd5b7bd70705b82b701cf: start","job_status":"start","queue_duration_s":0.599153,"scheduling_latency_s":0.599167}1367gitlab # [ 142.555713] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88fdd5b7bd70705b82b701cf","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88fdd5b7bd70705b82b701cf: done: 0.009719 sec","job_status":"done","queue_duration_s":0.599153,"scheduling_latency_s":0.599167,"redis_calls":13,"redis_duration_s":0.001606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009719,"completed_at":"2026-07-25T09:19:08.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 142.580638] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7329f517d75227685fd36a3","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7329f517d75227685fd36a3: start","job_status":"start","queue_duration_s":0.609969,"scheduling_latency_s":0.609994}1369gitlab # [ 142.592118] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7329f517d75227685fd36a3","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7329f517d75227685fd36a3: done: 0.009922 sec","job_status":"done","queue_duration_s":0.609969,"scheduling_latency_s":0.609994,"redis_calls":13,"redis_duration_s":0.0016450000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009922,"completed_at":"2026-07-25T09:19:08.317Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 142.635083] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33403418f1fa48f960f40585","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33403418f1fa48f960f40585: start","job_status":"start","queue_duration_s":0.620848,"scheduling_latency_s":0.620862}1371gitlab # [ 142.638693] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33403418f1fa48f960f40585","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33403418f1fa48f960f40585: done: 0.01016 sec","job_status":"done","queue_duration_s":0.620848,"scheduling_latency_s":0.620862,"redis_calls":13,"redis_duration_s":0.0016979999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01016,"completed_at":"2026-07-25T09:19:08.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 142.673425] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d4d6d005e7a1551e1161a7b","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d4d6d005e7a1551e1161a7b: start","job_status":"start","queue_duration_s":0.631815,"scheduling_latency_s":0.631828}1373gitlab # [ 142.717720] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d4d6d005e7a1551e1161a7b","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d4d6d005e7a1551e1161a7b: done: 0.009993 sec","job_status":"done","queue_duration_s":0.631815,"scheduling_latency_s":0.631828,"redis_calls":13,"redis_duration_s":0.001733,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009993,"completed_at":"2026-07-25T09:19:08.339Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 142.718735] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"557c7a8b693a4bbf23d8eb3a","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-557c7a8b693a4bbf23d8eb3a: start","job_status":"start","queue_duration_s":0.642732,"scheduling_latency_s":0.642745}1375gitlab # [ 142.761080] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"557c7a8b693a4bbf23d8eb3a","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-557c7a8b693a4bbf23d8eb3a: done: 0.010596 sec","job_status":"done","queue_duration_s":0.642732,"scheduling_latency_s":0.642745,"redis_calls":13,"redis_duration_s":0.0018219999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001279,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010596,"completed_at":"2026-07-25T09:19:08.351Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 142.799282] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08676fe9f9144f000c5233a0","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08676fe9f9144f000c5233a0: start","job_status":"start","queue_duration_s":0.654202,"scheduling_latency_s":0.654215}1377gitlab # [ 142.799976] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08676fe9f9144f000c5233a0","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08676fe9f9144f000c5233a0: done: 0.010573 sec","job_status":"done","queue_duration_s":0.654202,"scheduling_latency_s":0.654215,"redis_calls":13,"redis_duration_s":0.001938,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001399,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010573,"completed_at":"2026-07-25T09:19:08.362Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 142.810780] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc407bf248a682c66f03e446","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc407bf248a682c66f03e446: start","job_status":"start","queue_duration_s":0.665689,"scheduling_latency_s":0.665703}1379gitlab # [ 142.821843] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc407bf248a682c66f03e446","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc407bf248a682c66f03e446: done: 0.009977 sec","job_status":"done","queue_duration_s":0.665689,"scheduling_latency_s":0.665703,"redis_calls":13,"redis_duration_s":0.001611,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009977,"completed_at":"2026-07-25T09:19:08.373Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 142.878831] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abdc91b9541af79997b0cb63","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abdc91b9541af79997b0cb63: start","job_status":"start","queue_duration_s":0.676541,"scheduling_latency_s":0.676555}1381gitlab # [ 142.879763] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abdc91b9541af79997b0cb63","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abdc91b9541af79997b0cb63: done: 0.009822 sec","job_status":"done","queue_duration_s":0.676541,"scheduling_latency_s":0.676555,"redis_calls":13,"redis_duration_s":0.00165,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009822,"completed_at":"2026-07-25T09:19:08.384Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 142.901247] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54c4fa9aac194904c08488b7","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54c4fa9aac194904c08488b7: start","job_status":"start","queue_duration_s":0.687421,"scheduling_latency_s":0.687436}1383gitlab # [ 142.912744] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54c4fa9aac194904c08488b7","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54c4fa9aac194904c08488b7: done: 0.009911 sec","job_status":"done","queue_duration_s":0.687421,"scheduling_latency_s":0.687436,"redis_calls":13,"redis_duration_s":0.001644,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009911,"completed_at":"2026-07-25T09:19:08.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 142.961302] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"074f360c80fc392e7206dd7b","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-074f360c80fc392e7206dd7b: start","job_status":"start","queue_duration_s":0.698445,"scheduling_latency_s":0.698459}1385gitlab # [ 142.961982] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"074f360c80fc392e7206dd7b","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-074f360c80fc392e7206dd7b: done: 0.010061 sec","job_status":"done","queue_duration_s":0.698445,"scheduling_latency_s":0.698459,"redis_calls":13,"redis_duration_s":0.0016090000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010061,"completed_at":"2026-07-25T09:19:08.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 143.021031] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b418c88e4feb00ec6c410193","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b418c88e4feb00ec6c410193: start","job_status":"start","queue_duration_s":0.709528,"scheduling_latency_s":0.709542}1387gitlab # [ 143.021759] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b418c88e4feb00ec6c410193","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b418c88e4feb00ec6c410193: done: 0.01009 sec","job_status":"done","queue_duration_s":0.709528,"scheduling_latency_s":0.709542,"redis_calls":13,"redis_duration_s":0.001678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01009,"completed_at":"2026-07-25T09:19:08.417Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 143.041433] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14727d9765d7607d5a4588f6","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14727d9765d7607d5a4588f6: start","job_status":"start","queue_duration_s":0.720594,"scheduling_latency_s":0.720607}1389gitlab # [ 143.052529] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14727d9765d7607d5a4588f6","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14727d9765d7607d5a4588f6: done: 0.010069 sec","job_status":"done","queue_duration_s":0.720594,"scheduling_latency_s":0.720607,"redis_calls":13,"redis_duration_s":0.0018410000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001329,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010069,"completed_at":"2026-07-25T09:19:08.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 143.123277] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"511b05b025f957d14cfdde04","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-511b05b025f957d14cfdde04: start","job_status":"start","queue_duration_s":0.731892,"scheduling_latency_s":0.731906}1391gitlab # [ 143.123985] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"511b05b025f957d14cfdde04","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-511b05b025f957d14cfdde04: done: 0.009903 sec","job_status":"done","queue_duration_s":0.731892,"scheduling_latency_s":0.731906,"redis_calls":13,"redis_duration_s":0.001624,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009903,"completed_at":"2026-07-25T09:19:08.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 143.132534] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fa9c7a3d29594a7d1ac9917","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fa9c7a3d29594a7d1ac9917: start","job_status":"start","queue_duration_s":0.742678,"scheduling_latency_s":0.742691}1393gitlab # [ 143.143523] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fa9c7a3d29594a7d1ac9917","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fa9c7a3d29594a7d1ac9917: done: 0.01015 sec","job_status":"done","queue_duration_s":0.742678,"scheduling_latency_s":0.742691,"redis_calls":13,"redis_duration_s":0.001655,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01015,"completed_at":"2026-07-25T09:19:08.450Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 143.199578] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64b19f27ec6c3a1f288b6ac5","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64b19f27ec6c3a1f288b6ac5: start","job_status":"start","queue_duration_s":0.753748,"scheduling_latency_s":0.753762}1395gitlab # [ 143.200191] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64b19f27ec6c3a1f288b6ac5","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64b19f27ec6c3a1f288b6ac5: done: 0.010377 sec","job_status":"done","queue_duration_s":0.753748,"scheduling_latency_s":0.753762,"redis_calls":13,"redis_duration_s":0.002091,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001531,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010377,"completed_at":"2026-07-25T09:19:08.462Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 143.253722] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9db4ba31e2b4e6b405c3b2a","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9db4ba31e2b4e6b405c3b2a: start","job_status":"start","queue_duration_s":0.764914,"scheduling_latency_s":0.764928}1397gitlab # [ 143.254568] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9db4ba31e2b4e6b405c3b2a","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9db4ba31e2b4e6b405c3b2a: done: 0.010516 sec","job_status":"done","queue_duration_s":0.764914,"scheduling_latency_s":0.764928,"redis_calls":13,"redis_duration_s":0.00195,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001403,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010516,"completed_at":"2026-07-25T09:19:08.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 143.267661] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f3d222f6513cf24755f5554","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f3d222f6513cf24755f5554: start","job_status":"start","queue_duration_s":0.776328,"scheduling_latency_s":0.776343}1399gitlab # [ 143.278813] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f3d222f6513cf24755f5554","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f3d222f6513cf24755f5554: done: 0.010116 sec","job_status":"done","queue_duration_s":0.776328,"scheduling_latency_s":0.776343,"redis_calls":13,"redis_duration_s":0.001859,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001301,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010116,"completed_at":"2026-07-25T09:19:08.484Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 143.313849] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bbae53b87c9dad33eb0080f","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bbae53b87c9dad33eb0080f: start","job_status":"start","queue_duration_s":0.787353,"scheduling_latency_s":0.787368}1401gitlab # [ 143.324859] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bbae53b87c9dad33eb0080f","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bbae53b87c9dad33eb0080f: done: 0.010076 sec","job_status":"done","queue_duration_s":0.787353,"scheduling_latency_s":0.787368,"redis_calls":13,"redis_duration_s":0.001622,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010076,"completed_at":"2026-07-25T09:19:08.495Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 143.363977] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af019c45d9f88351efd1e20a","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af019c45d9f88351efd1e20a: start","job_status":"start","queue_duration_s":0.79829,"scheduling_latency_s":0.798304}1403gitlab # [ 143.403853] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af019c45d9f88351efd1e20a","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af019c45d9f88351efd1e20a: done: 0.010107 sec","job_status":"done","queue_duration_s":0.79829,"scheduling_latency_s":0.798304,"redis_calls":13,"redis_duration_s":0.00167,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010107,"completed_at":"2026-07-25T09:19:08.506Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 143.404711] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2b6d2ca8e964f3f0b548ebe","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2b6d2ca8e964f3f0b548ebe: start","job_status":"start","queue_duration_s":0.809414,"scheduling_latency_s":0.809426}1405gitlab # [ 143.414682] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2b6d2ca8e964f3f0b548ebe","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2b6d2ca8e964f3f0b548ebe: done: 0.009915 sec","job_status":"done","queue_duration_s":0.809414,"scheduling_latency_s":0.809426,"redis_calls":13,"redis_duration_s":0.00167,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009915,"completed_at":"2026-07-25T09:19:08.517Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 143.449671] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c97009f925ac7dd1ac35dbad","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c97009f925ac7dd1ac35dbad: start","job_status":"start","queue_duration_s":0.820364,"scheduling_latency_s":0.820377}1407gitlab # [ 143.460647] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c97009f925ac7dd1ac35dbad","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c97009f925ac7dd1ac35dbad: done: 0.009969 sec","job_status":"done","queue_duration_s":0.820364,"scheduling_latency_s":0.820377,"redis_calls":13,"redis_duration_s":0.0017,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009969,"completed_at":"2026-07-25T09:19:08.528Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 143.523280] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:08.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9437927eb48247eb71fd2ba","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9437927eb48247eb71fd2ba: start","job_status":"start","queue_duration_s":0.831352,"scheduling_latency_s":0.831366}1409gitlab # [ 143.683988] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1266344829 wd_nsec: 12663447141410gitlab # [ 143.554704] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9437927eb48247eb71fd2ba","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9437927eb48247eb71fd2ba: done: 1.611046 sec","job_status":"done","queue_duration_s":0.831352,"scheduling_latency_s":0.831366,"redis_calls":13,"redis_duration_s":0.002002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":1.611046,"completed_at":"2026-07-25T09:19:10.140Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 143.719551] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0aea9a25d5f2be0101d8c6d","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0aea9a25d5f2be0101d8c6d: start","job_status":"start","queue_duration_s":2.607527,"scheduling_latency_s":2.60758}1412gitlab # [ 143.765821] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0aea9a25d5f2be0101d8c6d","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0aea9a25d5f2be0101d8c6d: done: 0.046963 sec","job_status":"done","queue_duration_s":2.607527,"scheduling_latency_s":2.60758,"redis_calls":13,"redis_duration_s":0.0030169999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046963,"completed_at":"2026-07-25T09:19:10.352Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 143.821614] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"caf00651e05d7c54d5aea268","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-caf00651e05d7c54d5aea268: start","job_status":"start","queue_duration_s":2.710213,"scheduling_latency_s":2.710244}1414gitlab # [ 143.853098] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"caf00651e05d7c54d5aea268","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-caf00651e05d7c54d5aea268: done: 0.031227 sec","job_status":"done","queue_duration_s":2.710213,"scheduling_latency_s":2.710244,"redis_calls":13,"redis_duration_s":0.0027559999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001823,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031227,"completed_at":"2026-07-25T09:19:10.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 143.890090] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6775cfa9577032dbb46b14d3","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6775cfa9577032dbb46b14d3: start","job_status":"start","queue_duration_s":2.778383,"scheduling_latency_s":2.778423}1416gitlab # [ 143.923213] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6775cfa9577032dbb46b14d3","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6775cfa9577032dbb46b14d3: done: 0.033106 sec","job_status":"done","queue_duration_s":2.778383,"scheduling_latency_s":2.778423,"redis_calls":13,"redis_duration_s":0.003344,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002439,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033106,"completed_at":"2026-07-25T09:19:10.509Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 143.961337] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7886bf0b179fbdb5a7b9913","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7886bf0b179fbdb5a7b9913: start","job_status":"start","queue_duration_s":2.849626,"scheduling_latency_s":2.849667}1418gitlab # [ 143.994417] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7886bf0b179fbdb5a7b9913","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7886bf0b179fbdb5a7b9913: done: 0.032911 sec","job_status":"done","queue_duration_s":2.849626,"scheduling_latency_s":2.849667,"redis_calls":13,"redis_duration_s":0.002676,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001725,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032911,"completed_at":"2026-07-25T09:19:10.580Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 144.032524] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"145d729e5c747f61a768a15a","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-145d729e5c747f61a768a15a: start","job_status":"start","queue_duration_s":2.9208,"scheduling_latency_s":2.920844}1420gitlab # [ 144.065467] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"145d729e5c747f61a768a15a","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-145d729e5c747f61a768a15a: done: 0.032925 sec","job_status":"done","queue_duration_s":2.9208,"scheduling_latency_s":2.920844,"redis_calls":13,"redis_duration_s":0.0028209999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032925,"completed_at":"2026-07-25T09:19:10.651Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 144.104276] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fbd31edbe3c7f14d1af26a9","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fbd31edbe3c7f14d1af26a9: start","job_status":"start","queue_duration_s":2.992581,"scheduling_latency_s":2.992623}1422gitlab # [ 144.137794] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fbd31edbe3c7f14d1af26a9","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fbd31edbe3c7f14d1af26a9: done: 0.032849 sec","job_status":"done","queue_duration_s":2.992581,"scheduling_latency_s":2.992623,"redis_calls":13,"redis_duration_s":0.002816,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032849,"completed_at":"2026-07-25T09:19:10.723Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 144.175097] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8d445b7d336e258f4018933","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8d445b7d336e258f4018933: start","job_status":"start","queue_duration_s":3.06342,"scheduling_latency_s":3.063462}1424gitlab # [ 144.199656] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8d445b7d336e258f4018933","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8d445b7d336e258f4018933: done: 0.024458 sec","job_status":"done","queue_duration_s":3.06342,"scheduling_latency_s":3.063462,"redis_calls":13,"redis_duration_s":0.003986,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001331,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002655,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024458,"completed_at":"2026-07-25T09:19:10.785Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 144.239356] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35c5d8e7d9121868ddd59260","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35c5d8e7d9121868ddd59260: start","job_status":"start","queue_duration_s":3.12767,"scheduling_latency_s":3.127711}1426gitlab # [ 144.263878] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35c5d8e7d9121868ddd59260","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35c5d8e7d9121868ddd59260: done: 0.02438 sec","job_status":"done","queue_duration_s":3.12767,"scheduling_latency_s":3.127711,"redis_calls":13,"redis_duration_s":0.003981,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001284,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002697,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02438,"completed_at":"2026-07-25T09:19:10.849Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 144.302498] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16f3da70822c514e3ac1003e","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16f3da70822c514e3ac1003e: start","job_status":"start","queue_duration_s":3.190806,"scheduling_latency_s":3.190848}1428gitlab # [ 144.327633] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16f3da70822c514e3ac1003e","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16f3da70822c514e3ac1003e: done: 0.024403 sec","job_status":"done","queue_duration_s":3.190806,"scheduling_latency_s":3.190848,"redis_calls":13,"redis_duration_s":0.003825,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001222,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002603,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024403,"completed_at":"2026-07-25T09:19:10.913Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 144.366187] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4984d8890d1e558796722591","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4984d8890d1e558796722591: start","job_status":"start","queue_duration_s":3.254507,"scheduling_latency_s":3.254549}1430gitlab # [ 144.400135] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:10.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4984d8890d1e558796722591","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4984d8890d1e558796722591: done: 0.033886 sec","job_status":"done","queue_duration_s":3.254507,"scheduling_latency_s":3.254549,"redis_calls":13,"redis_duration_s":0.0031990000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001152,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002047,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033886,"completed_at":"2026-07-25T09:19:10.986Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 144.438924] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9aab0c3a7f3dbb86fcce227d","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9aab0c3a7f3dbb86fcce227d: start","job_status":"start","queue_duration_s":3.327273,"scheduling_latency_s":3.327317}1432gitlab # [ 144.472570] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9aab0c3a7f3dbb86fcce227d","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9aab0c3a7f3dbb86fcce227d: done: 0.033527 sec","job_status":"done","queue_duration_s":3.327273,"scheduling_latency_s":3.327317,"redis_calls":13,"redis_duration_s":0.002745,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015563,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033527,"completed_at":"2026-07-25T09:19:11.058Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 144.510732] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a93164ee136411780a97fb5","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a93164ee136411780a97fb5: start","job_status":"start","queue_duration_s":3.399096,"scheduling_latency_s":3.399139}1434gitlab # [ 144.544104] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a93164ee136411780a97fb5","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a93164ee136411780a97fb5: done: 0.033191 sec","job_status":"done","queue_duration_s":3.399096,"scheduling_latency_s":3.399139,"redis_calls":13,"redis_duration_s":0.002813,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033191,"completed_at":"2026-07-25T09:19:11.130Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 144.581364] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3810a9e8696d69f9e613ad3f","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3810a9e8696d69f9e613ad3f: start","job_status":"start","queue_duration_s":3.468739,"scheduling_latency_s":3.46878}1436gitlab # [ 144.607242] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3810a9e8696d69f9e613ad3f","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3810a9e8696d69f9e613ad3f: done: 0.026665 sec","job_status":"done","queue_duration_s":3.468739,"scheduling_latency_s":3.46878,"redis_calls":13,"redis_duration_s":0.004522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026665,"completed_at":"2026-07-25T09:19:11.193Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 144.612478] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"653fb093320f5bc3d644b974","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-653fb093320f5bc3d644b974: start","job_status":"start","queue_duration_s":3.500841,"scheduling_latency_s":3.500874}1438gitlab # [ 144.654373] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"653fb093320f5bc3d644b974","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-653fb093320f5bc3d644b974: done: 0.039589 sec","job_status":"done","queue_duration_s":3.500841,"scheduling_latency_s":3.500874,"redis_calls":13,"redis_duration_s":0.018944,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001324,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.01762,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039589,"completed_at":"2026-07-25T09:19:11.238Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 144.655297] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70534091a58bb2d201265b32","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70534091a58bb2d201265b32: start","job_status":"start","queue_duration_s":3.542355,"scheduling_latency_s":3.542383}1440gitlab # [ 144.667577] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70534091a58bb2d201265b32","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70534091a58bb2d201265b32: done: 0.013949 sec","job_status":"done","queue_duration_s":3.542355,"scheduling_latency_s":3.542383,"redis_calls":13,"redis_duration_s":0.001931,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000704,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001227,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013949,"completed_at":"2026-07-25T09:19:11.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 144.717789] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7acb5cbda451394572ba757","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7acb5cbda451394572ba757: start","job_status":"start","queue_duration_s":3.56229,"scheduling_latency_s":3.562306}1442gitlab # [ 144.718586] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7acb5cbda451394572ba757","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7acb5cbda451394572ba757: done: 0.01162 sec","job_status":"done","queue_duration_s":3.56229,"scheduling_latency_s":3.562306,"redis_calls":13,"redis_duration_s":0.002871,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01162,"completed_at":"2026-07-25T09:19:11.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 144.761785] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b2d54a8b3bee134d8083719","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b2d54a8b3bee134d8083719: start","job_status":"start","queue_duration_s":3.574727,"scheduling_latency_s":3.574741}1444gitlab # [ 144.762630] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b2d54a8b3bee134d8083719","created_at":"2026-07-25T09:19:07.643Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-5fe9d6b554124a61","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"235eb60afda461e9ebbbaf63da258ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:07.698Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b2d54a8b3bee134d8083719: done: 0.009919 sec","job_status":"done","queue_duration_s":3.574727,"scheduling_latency_s":3.574741,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000469,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009919,"completed_at":"2026-07-25T09:19:11.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 144.807620] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.283Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ddecfd1cf188c37c00c74dfd","created_at":"2026-07-25T09:19:08.136Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-4418b0b03f8f4fb3","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10d7e1513f6e23c478462381a7cc77d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:08.143Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ddecfd1cf188c37c00c74dfd: start","job_status":"start","queue_duration_s":3.139523,"scheduling_latency_s":3.139536}1446gitlab # [ 144.808469] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.293Z","message":"No existing merge request to be cleaned up."}1447gitlab # [ 144.809081] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.300Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ddecfd1cf188c37c00c74dfd","created_at":"2026-07-25T09:19:08.136Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-4418b0b03f8f4fb3","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10d7e1513f6e23c478462381a7cc77d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:08.143Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ddecfd1cf188c37c00c74dfd: done: 0.017397 sec","job_status":"done","queue_duration_s":3.139523,"scheduling_latency_s":3.139536,"redis_calls":13,"redis_duration_s":0.001689,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000746,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231315,"duration_s":0.017397,"completed_at":"2026-07-25T09:19:11.300Z","load_balancing_strategy":"primary","db_duration_s":0.002442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 144.855606] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.301Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5ff996be8b80f1e9b63f4208","created_at":"2026-07-25T09:19:08.136Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-4418b0b03f8f4fb3","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10d7e1513f6e23c478462381a7cc77d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:08.143Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5ff996be8b80f1e9b63f4208: start","job_status":"start","queue_duration_s":3.157751,"scheduling_latency_s":3.157764}1449gitlab # [ 144.856467] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.312Z","message":"No existing merge request to be cleaned up."}1450gitlab # [ 144.856962] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.317Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5ff996be8b80f1e9b63f4208","created_at":"2026-07-25T09:19:08.136Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-4418b0b03f8f4fb3","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10d7e1513f6e23c478462381a7cc77d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:08.143Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5ff996be8b80f1e9b63f4208: done: 0.015268 sec","job_status":"done","queue_duration_s":3.157751,"scheduling_latency_s":3.157764,"redis_calls":10,"redis_duration_s":0.006039,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001215,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004824,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015268,"completed_at":"2026-07-25T09:19:11.316Z","load_balancing_strategy":"primary","db_duration_s":0.001045,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 144.912091] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.317Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"69797b3f42179bb187dc46c9","created_at":"2026-07-25T09:19:08.136Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-4418b0b03f8f4fb3","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10d7e1513f6e23c478462381a7cc77d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:08.143Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-69797b3f42179bb187dc46c9: start","job_status":"start","queue_duration_s":3.173819,"scheduling_latency_s":3.173832}1452gitlab # [ 144.912780] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.323Z","message":"No existing merge request to be cleaned up."}1453gitlab # [ 144.913434] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.327Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"69797b3f42179bb187dc46c9","created_at":"2026-07-25T09:19:08.136Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-4418b0b03f8f4fb3","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10d7e1513f6e23c478462381a7cc77d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:08.143Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-69797b3f42179bb187dc46c9: done: 0.009974 sec","job_status":"done","queue_duration_s":3.173819,"scheduling_latency_s":3.173832,"redis_calls":10,"redis_duration_s":0.001202,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00072,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009974,"completed_at":"2026-07-25T09:19:11.327Z","load_balancing_strategy":"primary","db_duration_s":0.000982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 144.961272] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.328Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"528c5bf8b692ffcae1771725","created_at":"2026-07-25T09:19:08.136Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-4418b0b03f8f4fb3","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10d7e1513f6e23c478462381a7cc77d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:08.143Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-528c5bf8b692ffcae1771725: start","job_status":"start","queue_duration_s":3.18491,"scheduling_latency_s":3.184923}1455gitlab # [ 144.961912] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.334Z","message":"No existing merge request to be cleaned up."}1456gitlab # [ 144.962549] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:11.338Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"528c5bf8b692ffcae1771725","created_at":"2026-07-25T09:19:08.136Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-4418b0b03f8f4fb3","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10d7e1513f6e23c478462381a7cc77d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:08.143Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-528c5bf8b692ffcae1771725: done: 0.009938 sec","job_status":"done","queue_duration_s":3.18491,"scheduling_latency_s":3.184923,"redis_calls":10,"redis_duration_s":0.001227,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000722,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009938,"completed_at":"2026-07-25T09:19:11.338Z","load_balancing_strategy":"primary","db_duration_s":0.00093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 159.301738] setup-gitlab-start[2644]: W, [2026-07-25T09:19:25.887741 #2644] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1458gitlab # [ 181.032378] runuser[2643]: pam_unix(runuser:session): session closed for user gitlab1459gitlab # [ 181.038101] setup-gitlab-start[2850]: ++ jq -r .token1460gitlab # [ 181.040784] setup-gitlab-start[2851]: +++ date -d '+7 days' +%F1461gitlab # [ 181.043725] setup-gitlab-start[2849]: ++ curl -fs -X POST -H 'Authorization: Bearer 7b0db1e9c2c4d205fff77e9571379b988fdbb7dfdb639c29c31ebe136cb71c2e' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-08-01"}' http://gitlab/api/v4/users/1/personal_access_tokens1462gitlab # [ 181.283670] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:47.869Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"d4169ba04a52877526cc9724","created_at":"2026-07-25T09:19:47.817Z","trace_propagation_headers":{"sentry-trace":"3fb9028c99d1431680a5a7faf6dbde74-46cb8f18b3ef4554","baggage":"sentry-trace_id=3fb9028c99d1431680a5a7faf6dbde74,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95NDNCMFY0H6BWR77ZB4S","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:63520d706b3c657b91e78b7133bc091f8d20291f638d702d7427ea452b2c4868","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:47.865Z","job_size_bytes":451,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-d4169ba04a52877526cc9724: start","job_status":"start","queue_duration_s":0.003766,"scheduling_latency_s":0.00383}1463gitlab # [ 181.311646] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:47 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 2581464gitlab # [ 181.316645] setup-gitlab-start[2591]: + TOKEN=glpat-7Utw8zzvfEROnoftfbD_sW86MQp1OjEH.01.0w1kav9ft1465gitlab # [ 181.317677] setup-gitlab-start[2591]: + test -n glpat-7Utw8zzvfEROnoftfbD_sW86MQp1OjEH.01.0w1kav9ft1466gitlab # [ 181.318620] setup-gitlab-start[2591]: + test glpat-7Utw8zzvfEROnoftfbD_sW86MQp1OjEH.01.0w1kav9ft '!=' null1467gitlab # [ 181.319279] setup-gitlab-start[2591]: + mkdir -p /var/lib/secrets1468gitlab # [ 181.320359] setup-gitlab-start[2591]: + echo glpat-7Utw8zzvfEROnoftfbD_sW86MQp1OjEH.01.0w1kav9ft1469gitlab # [ 181.321261] setup-gitlab-start[2591]: + chmod 644 /var/lib/secrets/gitlab-token1470gitlab # [ 181.323960] setup-gitlab-start[2591]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-7Utw8zzvfEROnoftfbD_sW86MQp1OjEH.01.0w1kav9ft' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1471gitlab # [ 181.448079] sidekiq-cluster[2071]: {"severity":"WARN","time":"2026-07-25T09:19:48.033Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"d4169ba04a52877526cc9724","created_at":"2026-07-25T09:19:47.817Z","trace_propagation_headers":{"sentry-trace":"3fb9028c99d1431680a5a7faf6dbde74-46cb8f18b3ef4554","baggage":"sentry-trace_id=3fb9028c99d1431680a5a7faf6dbde74,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95NDNCMFY0H6BWR77ZB4S","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:63520d706b3c657b91e78b7133bc091f8d20291f638d702d7427ea452b2c4868","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:47.865Z","job_size_bytes":451,"pid":2071,"sidekiq_tid":"lyp3","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-d4169ba04a52877526cc9724: fail: 0.16462 sec","job_status":"fail","queue_duration_s":0.003766,"scheduling_latency_s":0.00383,"redis_calls":11,"redis_duration_s":0.00345,"redis_read_bytes":137,"redis_write_bytes":1317,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000948,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000626,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000356749,"duration_s":0.16462,"completed_at":"2026-07-25T09:19:48.033Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.052548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 182.144594] gitaly[1362]: time="2026-07-25T09:19:48.730Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:19:58.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:48.729" pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1473gitlab # [ 182.146425] gitaly[1362]: time="2026-07-25T09:19:48.730Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:19:58.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:48.729" grpc.time_ms=0.637 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1474gitlab # [ 182.252173] gitaly[1362]: time="2026-07-25T09:19:48.838Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:19:58.117" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:48.838" pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1475gitlab # [ 182.276760] gitaly[1362]: time="2026-07-25T09:19:48.863Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:19:58.117" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:48.838" grpc.time_ms=0.467 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1476gitlab # [ 182.336471] gitaly[1362]: time="2026-07-25T09:19:48.923Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC diskcache=b6d4444a-df14-4298-9c43-2d1f3a2468a9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-25T09:19:58.129" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:48.850" pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1477gitlab # [ 182.361571] gitaly[1362]: time="2026-07-25T09:19:48.948Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=326 command.oublock=32 command.real_time_ms=32 command.spawn_token_fork_ms=38 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-25T09:19:58.129" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:48.850" grpc.time_ms=73.045 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1478gitlab # [ 182.409409] gitaly[1362]: time="2026-07-25T09:19:48.995Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:19:58.274" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:48.995" pid=1362 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1479gitlab # [ 182.411666] gitaly[1362]: time="2026-07-25T09:19:48.996Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:19:58.274" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:48.995" grpc.time_ms=0.927 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1480gitlab # [ 182.466492] gitaly[1362]: time="2026-07-25T09:19:49.053Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T09:19:59.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:49.041" grpc.time_ms=11.618 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1481gitlab # [ 182.495987] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:49.081Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"1712dab8604ca086fa481ff8","created_at":"2026-07-25T09:19:49.066Z","trace_propagation_headers":{"sentry-trace":"63c805470ba6452e926deed645870db7-299474da21ea4961","baggage":"sentry-trace_id=63c805470ba6452e926deed645870db7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95NPRG9ZJKH0635N0Y5DC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:49.079Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-1712dab8604ca086fa481ff8: start","job_status":"start","queue_duration_s":0.002072,"scheduling_latency_s":0.002127}1482gitlab # [ 182.522905] gitaly[1362]: time="2026-07-25T09:19:49.109Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:19:59.078" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:49.109" pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1483gitlab # [ 182.523865] gitaly[1362]: time="2026-07-25T09:19:49.109Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:19:59.078" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:49.109" grpc.time_ms=0.385 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1484gitlab # [ 182.578267] gitaly[1362]: time="2026-07-25T09:19:49.164Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC diskcache=3818300e-37af-4b67-aa70-d33bd78f5f50 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-25T09:19:59.101" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:49.132" pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1485gitlab # [ 182.588600] gitaly[1362]: time="2026-07-25T09:19:49.165Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=321 command.oublock=32 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-25T09:19:59.101" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:49.132" grpc.time_ms=33.029 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1486gitlab # [ 182.589674] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:49.166Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"1712dab8604ca086fa481ff8","created_at":"2026-07-25T09:19:49.066Z","trace_propagation_headers":{"sentry-trace":"63c805470ba6452e926deed645870db7-299474da21ea4961","baggage":"sentry-trace_id=63c805470ba6452e926deed645870db7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95NPRG9ZJKH0635N0Y5DC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:49.079Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-1712dab8604ca086fa481ff8: done: 0.084655 sec","job_status":"done","queue_duration_s":0.002072,"scheduling_latency_s":0.002127,"redis_calls":10,"redis_duration_s":0.0037730000000000003,"redis_read_bytes":8,"redis_write_bytes":1165,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002033,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":7,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.053036349,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.084655,"completed_at":"2026-07-25T09:19:49.166Z","load_balancing_strategy":"primary","db_duration_s":0.016424,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1487gitlab # [ 182.601151] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:49.168Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"f19fb18e92a58e4d42378e57","created_at":"2026-07-25T09:19:49.096Z","trace_propagation_headers":{"sentry-trace":"63c805470ba6452e926deed645870db7-299474da21ea4961","baggage":"sentry-trace_id=63c805470ba6452e926deed645870db7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95NPRG9ZJKH0635N0Y5DC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:49.103Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-f19fb18e92a58e4d42378e57: start","job_status":"start","queue_duration_s":0.064894,"scheduling_latency_s":0.064931}1488gitlab # [ 182.614219] gitaly[1362]: time="2026-07-25T09:19:49.174Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:19:59.143" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:49.173" pid=1362 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1489gitlab # [ 182.654667] gitaly[1362]: time="2026-07-25T09:19:49.174Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:19:59.143" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:49.173" grpc.time_ms=0.639 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1490gitlab # [ 182.655559] gitaly[1362]: time="2026-07-25T09:19:49.191Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T09:19:59.151" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:49.182" grpc.time_ms=9.356 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 182.656218] gitaly[1362]: time="2026-07-25T09:19:49.219Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:19:59.188" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:49.218" grpc.time_ms=0.142 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1492gitlab # [ 182.656832] gitaly[1362]: time="2026-07-25T09:19:49.223Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-25T09:19:59.192" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:49.223" grpc.time_ms=0.379 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1493gitlab # [ 182.696797] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:49.279Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"f19fb18e92a58e4d42378e57","created_at":"2026-07-25T09:19:49.096Z","trace_propagation_headers":{"sentry-trace":"63c805470ba6452e926deed645870db7-299474da21ea4961","baggage":"sentry-trace_id=63c805470ba6452e926deed645870db7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95NPRG9ZJKH0635N0Y5DC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:49.103Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-f19fb18e92a58e4d42378e57: done: 0.11068 sec","job_status":"done","queue_duration_s":0.064894,"scheduling_latency_s":0.064931,"redis_calls":14,"redis_duration_s":0.006906000000000001,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00429,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001517,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07656252499999999,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.11068,"completed_at":"2026-07-25T09:19:49.279Z","load_balancing_strategy":"primary","db_duration_s":0.026319,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1494gitlab # [ 182.785240] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:49.371Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"12147b083f14f5dc7c546a75","created_at":"2026-07-25T09:19:49.365Z","trace_propagation_headers":{"sentry-trace":"63c805470ba6452e926deed645870db7-299474da21ea4961","baggage":"sentry-trace_id=63c805470ba6452e926deed645870db7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95NPRG9ZJKH0635N0Y5DC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:49.370Z","job_size_bytes":5,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-12147b083f14f5dc7c546a75: start","job_status":"start","queue_duration_s":0.001363,"scheduling_latency_s":0.001393}1495gitlab # [ 182.831604] gitaly[1362]: time="2026-07-25T09:19:49.418Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95NPRG9ZJKH0635N0Y5DC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T09:19:59.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:49.412" grpc.time_ms=5.985 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 182.876207] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:49.462Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"12147b083f14f5dc7c546a75","created_at":"2026-07-25T09:19:49.365Z","trace_propagation_headers":{"sentry-trace":"63c805470ba6452e926deed645870db7-299474da21ea4961","baggage":"sentry-trace_id=63c805470ba6452e926deed645870db7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95NPRG9ZJKH0635N0Y5DC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:49.370Z","job_size_bytes":5,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-12147b083f14f5dc7c546a75: done: 0.09109 sec","job_status":"done","queue_duration_s":0.001363,"scheduling_latency_s":0.001393,"redis_calls":12,"redis_duration_s":0.002275,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00064,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000365,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216508,"duration_s":0.09109,"completed_at":"2026-07-25T09:19:49.462Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014558,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1497gitlab # [ 182.901704] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:49.465Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"51452a73f41f6aa38190d357","created_at":"2026-07-25T09:19:49.393Z","trace_propagation_headers":{"sentry-trace":"63c805470ba6452e926deed645870db7-299474da21ea4961","baggage":"sentry-trace_id=63c805470ba6452e926deed645870db7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95NPRG9ZJKH0635N0Y5DC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:49.396Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-51452a73f41f6aa38190d357: start","job_status":"start","queue_duration_s":0.068469,"scheduling_latency_s":0.068516}1498gitlab # [ 183.116930] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:49.702Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"51452a73f41f6aa38190d357","created_at":"2026-07-25T09:19:49.393Z","trace_propagation_headers":{"sentry-trace":"63c805470ba6452e926deed645870db7-299474da21ea4961","baggage":"sentry-trace_id=63c805470ba6452e926deed645870db7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95NPRG9ZJKH0635N0Y5DC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:49.396Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-51452a73f41f6aa38190d357: done: 0.238096 sec","job_status":"done","queue_duration_s":0.068469,"scheduling_latency_s":0.068516,"redis_calls":11,"redis_duration_s":0.0027400000000000002,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00072,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001511,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000509,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.159,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.159,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.128467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000508724,"duration_s":0.238096,"completed_at":"2026-07-25T09:19:49.702Z","load_balancing_strategy":"primary","db_duration_s":0.104353,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 183.190680] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:49.776Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"af5cd138210c8e262f14fec8","created_at":"2026-07-25T09:19:49.398Z","trace_propagation_headers":{"sentry-trace":"63c805470ba6452e926deed645870db7-299474da21ea4961","baggage":"sentry-trace_id=63c805470ba6452e926deed645870db7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95NPRG9ZJKH0635N0Y5DC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:49.401Z","job_size_bytes":89,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-af5cd138210c8e262f14fec8: start","job_status":"start","queue_duration_s":0.375027,"scheduling_latency_s":0.375061}1500gitlab # [ 183.193867] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:49 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 18501501gitlab # [ 183.210065] setup-gitlab-start[2591]: + mkdir -p /tmp/test-flake1502gitlab # [ 183.213056] setup-gitlab-start[2591]: + cd /tmp/test-flake1503gitlab # [ 183.214168] setup-gitlab-start[2591]: + git init -b master1504gitlab # [ 183.239569] setup-gitlab-start[2895]: Initialized empty Git repository in /tmp/test-flake/.git/1505gitlab # [ 183.240865] setup-gitlab-start[2591]: + git config user.name test1506gitlab # [ 183.244557] setup-gitlab-start[2591]: + git config user.email test@example.com1507gitlab # [ 183.248474] setup-gitlab-start[2591]: + cat1508gitlab # [ 183.252311] setup-gitlab-start[2591]: + git add flake.nix1509gitlab # [ 183.256300] setup-gitlab-start[2591]: + git commit -m 'initial commit'1510gitlab # [ 183.263855] setup-gitlab-start[2900]: [master (root-commit) 277d40f] initial commit1511gitlab # [ 183.264960] setup-gitlab-start[2900]: 1 file changed, 10 insertions(+)1512gitlab # [ 183.265931] setup-gitlab-start[2900]: create mode 100644 flake.nix1513gitlab # [ 183.266829] setup-gitlab-start[2591]: + git remote add origin http://oauth2:glpat-7Utw8zzvfEROnoftfbD_sW86MQp1OjEH.01.0w1kav9ft@gitlab/root/test-flake.git1514gitlab # [ 183.273980] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:49.860Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"af5cd138210c8e262f14fec8","created_at":"2026-07-25T09:19:49.398Z","trace_propagation_headers":{"sentry-trace":"63c805470ba6452e926deed645870db7-299474da21ea4961","baggage":"sentry-trace_id=63c805470ba6452e926deed645870db7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95NPRG9ZJKH0635N0Y5DC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:49.401Z","job_size_bytes":89,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-af5cd138210c8e262f14fec8: done: 0.084012 sec","job_status":"done","queue_duration_s":0.375027,"scheduling_latency_s":0.375061,"redis_calls":11,"redis_duration_s":0.00358,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00095,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001446,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001184,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000353955,"duration_s":0.084012,"completed_at":"2026-07-25T09:19:49.860Z","load_balancing_strategy":"primary","db_duration_s":0.020687,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 183.275681] setup-gitlab-start[2591]: + git push -u origin master1516gitlab # [ 183.429446] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:50 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 941517gitlab # [ 183.582987] gitaly[1362]: time="2026-07-25T09:19:50.169Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QR1ZPS1Y8D68SGRFSHK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:50.156" grpc.time_ms=11.966 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1518gitlab # [ 183.585260] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:50 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 1521519gitlab # [ 183.850260] gitaly[1362]: time="2026-07-25T09:19:50.436Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T09:20:00.014" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:50.425" grpc.time_ms=11.123 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1520gitlab # [ 183.889161] gitaly[1362]: time="2026-07-25T09:19:50.475Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-25T09:20:20.061" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-25T09:19:50.461" grpc.time_ms=13.695 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1521gitlab # [ 183.903429] gitaly[1362]: time="2026-07-25T09:19:50.490Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KYC95QYA7D5PCHFE04VYQVCH duration_ms=113ns method=POST pid=1362 status=200 url="http://unix/api/v4/internal/allowed"1522gitlab # [ 183.927151] gitaly[1362]: time="2026-07-25T09:19:50.513Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KYC95QYA7D5PCHFE04VYQVCH duration_ms=21ns method=POST pid=1362 status=200 url="http://unix/api/v4/internal/pre_receive"1523gitlab # [ 183.930325] gitaly[1362]: time="2026-07-25T09:19:50.515Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:50.375" grpc.time_ms=139.976 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1524gitlab # [ 183.964812] gitaly[1362]: time="2026-07-25T09:19:50.551Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:50.550" grpc.time_ms=0.769 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1525gitlab # [ 184.008157] gitaly[1362]: time="2026-07-25T09:19:50.594Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:50.594" grpc.time_ms=0.408 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1526gitlab # [ 184.039230] gitaly[1362]: time="2026-07-25T09:19:50.625Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:50.625" grpc.time_ms=0.577 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1527gitlab # [ 184.129192] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:50.714Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 277d40fa6b170e75a6656a6c527a3db7d4ccd1e0 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"268b56cb8738fd75cb5f7e28","created_at":"2026-07-25T09:19:50.694Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-c7b6d63ba2ab4648","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:50.711Z","job_size_bytes":185,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-268b56cb8738fd75cb5f7e28: start","job_status":"start","queue_duration_s":0.002735,"scheduling_latency_s":0.002767}1528gitlab # [ 184.142637] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:50.729Z","message":"changes: \"0000000000000000000000000000000000000000 277d40fa6b170e75a6656a6c527a3db7d4ccd1e0 refs/heads/master\\n\""}1529gitlab # [ 184.181157] gitaly[1362]: time="2026-07-25T09:19:50.767Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T09:20:00.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:50.761" grpc.time_ms=6.664 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1530gitlab # [ 184.196266] gitaly[1362]: time="2026-07-25T09:19:50.783Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=15 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T09:20:00.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:50.764" grpc.time_ms=18.557 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1531gitlab # [ 184.200032] gitaly[1362]: time="2026-07-25T09:19:50.786Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:20:00.030" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:50.780" grpc.time_ms=6.062 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1532gitlab # [ 184.216084] gitaly[1362]: time="2026-07-25T09:19:50.802Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1571 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-25T09:20:00.040" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:50.790" grpc.time_ms=11.867 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1533gitlab # [ 184.257442] gitaly[1362]: time="2026-07-25T09:19:50.844Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=14 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-25T09:20:00.073" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:50.823" grpc.time_ms=20.792 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1534gitlab # [ 184.259683] gitaly[1362]: time="2026-07-25T09:19:50.846Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KYC95QYA7D5PCHFE04VYQVCH duration_ms=192ns method=POST pid=1362 status=200 url="http://unix/api/v4/internal/post_receive"1535gitlab # [ 184.261638] gitaly[1362]: time="2026-07-25T09:19:50.848Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:50.653" grpc.time_ms=194.741 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1536gitlab # [ 184.292671] gitaly[1362]: time="2026-07-25T09:19:50.879Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3942 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:50.879" grpc.time_ms=0.252 pid=1362 span.kind=server system=grpc1537gitlab # [ 184.294589] gitaly[1362]: time="2026-07-25T09:19:50.881Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH diskcache=611d5ceb-47db-4fe7-965f-281e6889972d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:50.310" pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1538gitlab # [ 184.296347] gitaly[1362]: time="2026-07-25T09:19:50.881Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=161 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13413 command.oublock=32 command.real_time_ms=560 command.spawn_token_fork_ms=0 command.system_time_ms=105 command.user_time_ms=56 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:50.310" grpc.time_ms=571.191 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1539gitlab # [ 184.297280] gitlab-workhorse[1285]: time="2026-07-25T09:19:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521540gitlab # [ 184.297727] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:50 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 6631541gitlab # [ 184.325858] setup-gitlab-start[2904]: To http://gitlab/root/test-flake.git1542gitlab # [ 184.326563] setup-gitlab-start[2904]: * [new branch] master -> master1543gitlab # [ 184.328967] setup-gitlab-start[2904]: branch 'master' set up to track 'origin/master'.1544gitlab # [ 184.331368] systemd[1]: Finished setup-gitlab.service.1545gitlab # [ 184.333992] systemd[1]: Starting nixbot CI service...1546gitlab # [ 184.347689] gitaly[1362]: time="2026-07-25T09:19:50.934Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3944 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:50.934" grpc.time_ms=0.379 pid=1362 span.kind=server system=grpc1547gitlab # [ 184.365942] gitaly[1362]: time="2026-07-25T09:19:50.952Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH diskcache=791d3165-3cd9-4bf6-bdf5-65772ac0f70f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T09:20:00.102" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:50.852" pid=1362 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1548gitlab # [ 184.368326] gitaly[1362]: time="2026-07-25T09:19:50.953Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=46 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4855 command.oublock=8 command.real_time_ms=91 command.spawn_token_fork_ms=1 command.system_time_ms=34 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T09:20:00.102" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:50.852" grpc.time_ms=100.1 pid=1362 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1549gitlab # [ 184.381791] gitaly[1362]: time="2026-07-25T09:19:50.968Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:20:00.218" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:50.968" grpc.time_ms=0.138 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1550gitlab # [ 184.393455] gitaly[1362]: time="2026-07-25T09:19:50.980Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=939 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-25T09:20:00.222" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:50.972" grpc.time_ms=7.496 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1551gitlab # [ 184.454260] gitaly[1362]: time="2026-07-25T09:19:51.041Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-07-25T09:20:21.036" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:51.036" grpc.time_ms=4.074 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1552gitlab # [ 184.488190] gitaly[1362]: time="2026-07-25T09:19:51.075Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-25T09:20:01.004" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:51.074" grpc.time_ms=0.206 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1553gitlab # [ 184.502950] gitaly[1362]: time="2026-07-25T09:19:51.089Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-25T09:20:01.016" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-07-25T09:19:51.086" grpc.time_ms=3.546 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1554gitlab # [ 184.536350] gitaly[1362]: time="2026-07-25T09:19:51.123Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:20:01.046" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:51.117" grpc.time_ms=5.912 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1555gitlab # [ 184.549860] gitaly[1362]: time="2026-07-25T09:19:51.133Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:20:01.057" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:51.127" grpc.time_ms=5.343 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1556gitlab # [ 184.561958] gitaly[1362]: time="2026-07-25T09:19:51.148Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-25T09:20:21.140" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:51.140" grpc.time_ms=7.748 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1557gitlab # [ 184.796304] gitaly[1362]: time="2026-07-25T09:19:51.382Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-25T09:20:01.010" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:51.380" grpc.time_ms=1.669 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1558gitlab # [ 184.862144] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:51.448Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 277d40fa6b170e75a6656a6c527a3db7d4ccd1e0 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"268b56cb8738fd75cb5f7e28","created_at":"2026-07-25T09:19:50.694Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-c7b6d63ba2ab4648","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:50.711Z","job_size_bytes":185,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-268b56cb8738fd75cb5f7e28: done: 0.733897 sec","job_status":"done","queue_duration_s":0.002735,"scheduling_latency_s":0.002767,"gitaly_calls":14,"gitaly_duration_s":0.298651,"redis_calls":201,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.042612,"redis_read_bytes":922,"redis_write_bytes":19882,"redis_cache_calls":14,"redis_cache_duration_s":0.003725,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":32,"redis_feature_flag_duration_s":0.006516,"redis_feature_flag_read_bytes":540,"redis_feature_flag_write_bytes":4279,"redis_queues_calls":8,"redis_queues_duration_s":0.00088,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4933,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003165,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":92,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.016053,"redis_repository_cache_read_bytes":214,"redis_repository_cache_write_bytes":6392,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.012273,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":51,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":51,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":51,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.168,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.184,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.348559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000460393,"exclusive_lock_hold_duration_s":0.01744244,"duration_s":0.733897,"completed_at":"2026-07-25T09:19:51.448Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.059129,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1559gitlab # [ 184.939359] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:51.525Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a5b6ea2717aad4b3a4f8efde","created_at":"2026-07-25T09:19:50.803Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-fe64a569777040be","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:50.807Z","job_size_bytes":46,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a5b6ea2717aad4b3a4f8efde: start","job_status":"start","queue_duration_s":0.718199,"scheduling_latency_s":0.718249}1560gitlab # [ 185.012796] gitaly[1362]: time="2026-07-25T09:19:51.599Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-07-25T15:19:51.596" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:51.597" grpc.time_ms=2.175 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1561gitlab # [ 185.046188] gitaly[1362]: time="2026-07-25T09:19:51.632Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-25T09:20:21.624" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:51.624" grpc.time_ms=7.94 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1562gitlab # [ 185.072225] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:51.658Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a5b6ea2717aad4b3a4f8efde","created_at":"2026-07-25T09:19:50.803Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-fe64a569777040be","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:50.807Z","job_size_bytes":46,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a5b6ea2717aad4b3a4f8efde: done: 0.133479 sec","job_status":"done","queue_duration_s":0.718199,"scheduling_latency_s":0.718249,"gitaly_calls":2,"gitaly_duration_s":0.032797,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.009001,"redis_read_bytes":68,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000913,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000337,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00125,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.005898,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":752,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000603,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000190247,"duration_s":0.133479,"completed_at":"2026-07-25T09:19:51.658Z","load_balancing_strategy":"primary","db_duration_s":0.014997,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1563gitlab # [ 185.116834] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:51.703Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"3b3d6723dcd3a6d76d37f4e1","created_at":"2026-07-25T09:19:50.816Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-fe64a569777040be","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:50.819Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-3b3d6723dcd3a6d76d37f4e1: start","job_status":"start","queue_duration_s":0.883852,"scheduling_latency_s":0.883895}1564gitlab # [ 185.173066] gitaly[1362]: time="2026-07-25T09:19:51.759Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH diskcache=d6bbd697-ed92-4ebf-ad80-9f4750c04742 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-25T15:19:51.733" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:51.734" pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1565gitlab # [ 185.174509] gitaly[1362]: time="2026-07-25T09:19:51.760Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1280 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-25T15:19:51.733" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:51.734" grpc.time_ms=25.755 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1566gitlab # [ 185.219504] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:51.805Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"3b3d6723dcd3a6d76d37f4e1","created_at":"2026-07-25T09:19:50.816Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-fe64a569777040be","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:50.819Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-3b3d6723dcd3a6d76d37f4e1: done: 0.102146 sec","job_status":"done","queue_duration_s":0.883852,"scheduling_latency_s":0.883895,"gitaly_calls":1,"gitaly_duration_s":0.028022,"redis_calls":15,"redis_duration_s":0.0051329999999999995,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000812,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001896,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000826,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001599,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.022,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07181219999999999,"duration_s":0.102146,"completed_at":"2026-07-25T09:19:51.805Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01723,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab: (finished: waiting for unit setup-gitlab.service, in 185.99 seconds)1568gitlab # [ 185.222310] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:51.806Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"8413e89b2e461a9fd08ddd93","created_at":"2026-07-25T09:19:50.964Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-fe64a569777040be","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:50.966Z","job_size_bytes":23,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8413e89b2e461a9fd08ddd93: start","job_status":"start","queue_duration_s":0.840158,"scheduling_latency_s":0.840173}1569gitlab: waiting for unit nixbot.service1570gitlab # [ 185.279454] gitaly[1362]: time="2026-07-25T09:19:51.866Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=37 command.spawn_token_fork_ms=33 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-25T09:20:21.827" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:51.827" grpc.time_ms=38.482 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1571gitlab # [ 185.298429] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:51.884Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"8413e89b2e461a9fd08ddd93","created_at":"2026-07-25T09:19:50.964Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-fe64a569777040be","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:50.966Z","job_size_bytes":23,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8413e89b2e461a9fd08ddd93: done: 0.078383 sec","job_status":"done","queue_duration_s":0.840158,"scheduling_latency_s":0.840173,"gitaly_calls":1,"gitaly_duration_s":0.05137,"redis_calls":16,"redis_duration_s":0.004248,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000227,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001081,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001713,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.078383,"completed_at":"2026-07-25T09:19:51.884Z","load_balancing_strategy":"primary","db_duration_s":0.00152,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1572gitlab # [ 185.341198] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:51.927Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"314a4550d8688b62e7c67e31","created_at":"2026-07-25T09:19:51.349Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-fe64a569777040be","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b48548ac78968b8810adf826377a9ba43b992d5f8ae3e1144f25979ee49aaebc","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:51.353Z","job_size_bytes":467,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-314a4550d8688b62e7c67e31: start","job_status":"start","queue_duration_s":0.573804,"scheduling_latency_s":0.573833}1573gitlab # [ 185.373838] gitaly[1362]: time="2026-07-25T09:19:51.960Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:21.058" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:51.959" grpc.time_ms=0.752 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1574gitlab # [ 185.386253] gitaly[1362]: time="2026-07-25T09:19:51.973Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-25T09:20:01.004" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:51.965" grpc.time_ms=7.459 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1575gitlab # [ 185.455647] nixbot[3022]: {"ts": "2026-07-25T09:19:52.041Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1576gitlab # [ 185.481989] nixbot[3022]: {"ts": "2026-07-25T09:19:52.068Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1577gitlab # [ 185.507536] nixbot[3022]: {"ts": "2026-07-25T09:19:52.094Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1578gitlab # [ 185.516494] nixbot[3022]: {"ts": "2026-07-25T09:19:52.103Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1579gitlab # [ 185.521896] nixbot[3022]: {"ts": "2026-07-25T09:19:52.108Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1580gitlab # [ 185.529065] nixbot[3022]: {"ts": "2026-07-25T09:19:52.115Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1581gitlab # [ 185.535491] gitaly[1362]: time="2026-07-25T09:19:52.122Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:20:22.019" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:52.120" grpc.time_ms=1.208 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1582gitlab # [ 185.541707] nixbot[3022]: {"ts": "2026-07-25T09:19:52.128Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1583gitlab # [ 185.543226] gitaly[1362]: time="2026-07-25T09:19:52.128Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=222 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-25T09:20:22.024" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:52.124" grpc.time_ms=3.312 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1584gitlab # [ 185.544585] nixbot[3022]: {"ts": "2026-07-25T09:19:52.131Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1585gitlab # [ 185.550431] nixbot[3022]: {"ts": "2026-07-25T09:19:52.137Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1586gitlab # [ 185.552759] nixbot[3022]: {"ts": "2026-07-25T09:19:52.139Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1587gitlab # [ 185.558397] nixbot[3022]: {"ts": "2026-07-25T09:19:52.145Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1588gitlab # [ 185.564935] nixbot[3022]: {"ts": "2026-07-25T09:19:52.151Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1589gitlab # [ 185.568582] nixbot[3022]: {"ts": "2026-07-25T09:19:52.155Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1590gitlab # [ 185.570939] nixbot[3022]: {"ts": "2026-07-25T09:19:52.157Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1591gitlab # [ 185.574259] nixbot[3022]: {"ts": "2026-07-25T09:19:52.161Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1592gitlab # [ 185.576243] nixbot[3022]: {"ts": "2026-07-25T09:19:52.162Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1593gitlab # [ 185.579059] nixbot[3022]: {"ts": "2026-07-25T09:19:52.165Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1594gitlab # [ 185.581080] nixbot[3022]: {"ts": "2026-07-25T09:19:52.167Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1595gitlab # [ 185.584483] nixbot[3022]: {"ts": "2026-07-25T09:19:52.171Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1596gitlab # [ 185.587090] nixbot[3022]: {"ts": "2026-07-25T09:19:52.173Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1597gitlab # [ 185.589643] nixbot[3022]: {"ts": "2026-07-25T09:19:52.176Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1598gitlab # [ 185.593861] nixbot[3022]: {"ts": "2026-07-25T09:19:52.180Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1599gitlab # [ 185.596321] nixbot[3022]: {"ts": "2026-07-25T09:19:52.183Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1600gitlab # [ 185.630873] gitaly[1362]: time="2026-07-25T09:19:52.217Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:20:02.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:52.204" grpc.time_ms=13.34 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1601gitlab # [ 185.925178] nixbot[3022]: INFO: Started server process [3022]1602gitlab # [ 185.926048] nixbot[3022]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1603gitlab # [ 185.936086] nixbot[3022]: INFO: ::ffff:127.0.0.1:50714 - "GET /health HTTP/1.1" 200 OK1604gitlab # [ 185.944172] systemd[1]: Started nixbot CI service.1605gitlab # [ 185.949432] systemd[1]: Reached target Multi-User System.1606gitlab # [ 185.952434] systemd[1]: Startup finished in 1.241s (kernel) + 4.187s (initrd) + 3min 523ms (userspace) = 3min 5.951s.1607gitlab # [ 186.092604] gitaly[1362]: time="2026-07-25T09:19:52.679Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=958 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KYC95T5JDD43YCP3HMF04MKP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-25T09:20:22.265" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:52.665" grpc.time_ms=13.336 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1608gitlab # [ 186.115508] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:52 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 2021609gitlab # [ 186.117315] nixbot[3022]: {"ts": "2026-07-25T09:19:52.704Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1610gitlab # [ 186.140119] nixbot[3022]: {"ts": "2026-07-25T09:19:52.726Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1611gitlab # [ 186.199603] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 521612gitlab # [ 186.200745] nixbot[3022]: {"ts": "2026-07-25T09:19:52.787Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1613gitlab # [ 186.201664] nixbot[3022]: {"ts": "2026-07-25T09:19:52.788Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1614gitlab # [ 186.223102] gitaly[1362]: time="2026-07-25T09:19:52.809Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=970 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-25T09:20:22.695" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:52.795" grpc.time_ms=13.472 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 186.246077] gitaly[1362]: time="2026-07-25T09:19:52.831Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95QYA7D5PCHFE04VYQVCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-25T09:20:22.723" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:52.823" grpc.time_ms=8.03 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1616gitlab # [ 186.270143] sidekiq-cluster[2071]: {"severity":"WARN","time":"2026-07-25T09:19:52.856Z","class":"CreatePipelineWorker","correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"277d40fa6b170e75a6656a6c527a3db7d4ccd1e0","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"277d40fa6b170e75a6656a6c527a3db7d4ccd1e0","ref":"refs/heads/master"},"retry":0}1617gitlab # [ 186.281400] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:52.867Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"314a4550d8688b62e7c67e31","created_at":"2026-07-25T09:19:51.349Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-fe64a569777040be","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b48548ac78968b8810adf826377a9ba43b992d5f8ae3e1144f25979ee49aaebc","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:51.353Z","job_size_bytes":467,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-314a4550d8688b62e7c67e31: done: 0.940291 sec","job_status":"done","queue_duration_s":0.573804,"scheduling_latency_s":0.573833,"gitaly_calls":7,"gitaly_duration_s":0.077589,"redis_calls":53,"redis_duration_s":0.095184,"redis_read_bytes":171,"redis_write_bytes":4427,"redis_cache_calls":4,"redis_cache_duration_s":0.000856,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.083277,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007591,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002781,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000679,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":40,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":40,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.651227,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000204216,"duration_s":0.940291,"completed_at":"2026-07-25T09:19:52.867Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.063657,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1618gitlab # [ 186.325697] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:52.912Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"c3ca2832b5a336a6f84ee396","created_at":"2026-07-25T09:19:51.647Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-e216e5629cf04247","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:51.651Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-c3ca2832b5a336a6f84ee396: start","job_status":"start","queue_duration_s":1.260685,"scheduling_latency_s":1.26071}1619gitlab # [ 186.330611] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 1271620gitlab # [ 186.343096] nixbot[3022]: {"ts": "2026-07-25T09:19:52.929Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1621gitlab # [ 186.360569] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:52.947Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"c3ca2832b5a336a6f84ee396","created_at":"2026-07-25T09:19:51.647Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-e216e5629cf04247","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:51.651Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-c3ca2832b5a336a6f84ee396: done: 0.034991 sec","job_status":"done","queue_duration_s":1.260685,"scheduling_latency_s":1.26071,"redis_calls":19,"redis_duration_s":0.004009,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000693,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000644,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002049,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000623,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005427506,"duration_s":0.034991,"completed_at":"2026-07-25T09:19:52.947Z","load_balancing_strategy":"primary","db_duration_s":0.006687,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1622gitlab # [ 186.406099] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:52.992Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"9616953ac4a1d03f34b18663","created_at":"2026-07-25T09:19:52.937Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-9eb56f7ad7e84ce4","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:52.941Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-9616953ac4a1d03f34b18663: start","job_status":"start","queue_duration_s":0.051582,"scheduling_latency_s":0.051607}1623gitlab: (finished: waiting for unit nixbot.service, in 1.08 seconds)1624gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1625gitlab # [ 186.450232] nixbot[3022]: INFO: ::ffff:127.0.0.1:50718 - "GET /health HTTP/1.1" 200 OK1626gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds)1627subtest: project discovered and webhook registered1628gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1629gitlab # [ 186.517669] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 411630gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.07 seconds)1631(finished: subtest: project discovered and webhook registered, in 0.07 seconds)1632subtest: push delivers the webhook1633gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1634gitlab # [ 186.544686] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:53.131Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"9616953ac4a1d03f34b18663","created_at":"2026-07-25T09:19:52.937Z","trace_propagation_headers":{"sentry-trace":"02d7fab3a90f4d5db34d2a68a08ce512-9eb56f7ad7e84ce4","baggage":"sentry-trace_id=02d7fab3a90f4d5db34d2a68a08ce512,sentry-release=Unknown"},"correlation_id":"01KYC95QYA7D5PCHFE04VYQVCH","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:52.941Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-9616953ac4a1d03f34b18663: done: 0.138511 sec","job_status":"done","queue_duration_s":0.051582,"scheduling_latency_s":0.051607,"redis_calls":11,"redis_duration_s":0.0021579999999999998,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000423,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000352,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.110677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000275454,"duration_s":0.138511,"completed_at":"2026-07-25T09:19:53.131Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635gitlab # [ 186.617103] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:53 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 251636gitlab # [ 186.669480] gitaly[1362]: time="2026-07-25T09:19:53.256Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TVMMTRHJFXQ90P3ZAAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:53.249" grpc.time_ms=7.191 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1637gitlab # [ 186.692444] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:53 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 200 "" "git/2.54.0" 721638gitlab # Enumerating objects: 5, done.1639gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1640gitlab # Delta compression using up to 4 threads1641gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1642gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1643gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1644gitlab # [ 186.872496] gitaly[1362]: time="2026-07-25T09:19:53.459Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-25T09:20:03.039" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:53.451" grpc.time_ms=7.388 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1645gitlab # [ 186.933557] gitaly[1362]: time="2026-07-25T09:19:53.520Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-25T09:20:23.110" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-25T09:19:53.511" grpc.time_ms=8.688 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1646gitlab # [ 186.966045] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:53 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 6101647gitlab # [ 186.967379] nixbot[3022]: {"ts": "2026-07-25T09:19:53.553Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1648gitlab # [ 186.973984] gitaly[1362]: time="2026-07-25T09:19:53.560Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KYC95TYCES06CAXGRFZJS14K duration_ms=149ns method=POST pid=1362 status=200 url="http://unix/api/v4/internal/allowed"1649gitlab # [ 186.997342] gitaly[1362]: time="2026-07-25T09:19:53.584Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KYC95TYCES06CAXGRFZJS14K duration_ms=22ns method=POST pid=1362 status=200 url="http://unix/api/v4/internal/pre_receive"1650gitlab # [ 187.003429] gitaly[1362]: time="2026-07-25T09:19:53.590Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:53.410" grpc.time_ms=179.323 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1651gitlab # [ 187.014677] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 361652gitlab # [ 187.019030] nixbot[3022]: {"ts": "2026-07-25T09:19:53.604Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1653gitlab # [ 187.043462] gitaly[1362]: time="2026-07-25T09:19:53.630Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:53.629" grpc.time_ms=0.466 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1654gitlab # [ 187.077225] gitaly[1362]: time="2026-07-25T09:19:53.664Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:53.663" grpc.time_ms=0.296 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1655gitlab # [ 187.105350] gitaly[1362]: time="2026-07-25T09:19:53.691Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:53.691" grpc.time_ms=0.232 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1656gitlab # [ 187.159150] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:53.743Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","277d40fa6b170e75a6656a6c527a3db7d4ccd1e0 f86ec66befc33c10476f5f3558ea79591a92b335 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5265b9e3ca9f2b30faa9fec5","created_at":"2026-07-25T09:19:53.741Z","trace_propagation_headers":{"sentry-trace":"a0c6c1d9bc6d4a8f873e37101ded82a8-9b7818c817504f51","baggage":"sentry-trace_id=a0c6c1d9bc6d4a8f873e37101ded82a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95TYCES06CAXGRFZJS14K","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:53.742Z","job_size_bytes":185,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5265b9e3ca9f2b30faa9fec5: start","job_status":"start","queue_duration_s":0.001241,"scheduling_latency_s":0.001271}1657gitlab # [ 187.160619] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:53 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 1391658gitlab # [ 187.161987] nixbot[3022]: {"ts": "2026-07-25T09:19:53.748Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1659gitlab # [ 187.184958] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:53.771Z","message":"changes: \"277d40fa6b170e75a6656a6c527a3db7d4ccd1e0 f86ec66befc33c10476f5f3558ea79591a92b335 refs/heads/master\\n\""}1660gitlab # [ 187.194875] gitaly[1362]: time="2026-07-25T09:19:53.781Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KYC95TYCES06CAXGRFZJS14K duration_ms=60ns method=POST pid=1362 status=200 url="http://unix/api/v4/internal/post_receive"1661gitlab # [ 187.200218] gitaly[1362]: time="2026-07-25T09:19:53.786Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:53.721" grpc.time_ms=65.149 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1662gitlab # [ 187.211169] gitaly[1362]: time="2026-07-25T09:19:53.798Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:20:03.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:53.789" grpc.time_ms=8.458 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1663gitlab # [ 187.215075] gitaly[1362]: time="2026-07-25T09:19:53.801Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95VCV0HEHPHNV0WNQ8CP9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-07-25T09:20:23.394" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=255 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:53.794" grpc.time_ms=7.174 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1664gitlab # [ 187.225059] gitaly[1362]: time="2026-07-25T09:19:53.811Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T09:20:03.022" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:53.802" grpc.time_ms=9.459 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1665gitlab # [ 187.264996] gitaly[1362]: time="2026-07-25T09:19:53.851Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K diskcache=3f99a91f-e6f1-4b5f-b08d-58345c987f5e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:53.341" pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1666gitlab # [ 187.266607] gitaly[1362]: time="2026-07-25T09:19:53.853Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=197 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=872448 command.minflt=13122 command.oublock=32 command.real_time_ms=500 command.spawn_token_fork_ms=1 command.system_time_ms=140 command.user_time_ms=57 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:53.341" grpc.time_ms=511.919 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1667gitlab # [ 187.268317] gitlab-workhorse[1285]: time="2026-07-25T09:19:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521668gitlab # [ 187.268878] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:53 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 5611669gitlab # To http://gitlab/root/test-flake.git1670gitlab # 277d40f..f86ec66 master -> master1671gitlab # [ 187.290903] gitaly[1362]: time="2026-07-25T09:19:53.877Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95VCV0HEHPHNV0WNQ8CP9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:23.476" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:53.877" grpc.time_ms=0.496 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1672gitlab # [ 187.300118] gitaly[1362]: time="2026-07-25T09:19:53.886Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95VCV0HEHPHNV0WNQ8CP9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-25T09:20:03.160" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:53.880" grpc.time_ms=6.048 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1673gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.80 seconds)1674gitlab: must succeed: git -C /tmp/test-flake rev-parse master1675gitlab # [ 187.320355] gitaly[1362]: time="2026-07-25T09:19:53.907Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-25T09:20:03.096" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:53.901" grpc.time_ms=5.324 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676gitlab # [ 187.330430] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 771 "" "python-httpx/0.28.1" 1611677gitlab # [ 187.331486] nixbot[3022]: {"ts": "2026-07-25T09:19:53.918Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1678gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1679gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f86ec66befc33c10476f5f3558ea79591a92b335'1680gitlab # [ 187.344375] gitaly[1362]: time="2026-07-25T09:19:53.931Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-07-25T09:20:23.023" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:53.924" grpc.time_ms=7.005 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1681gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f86ec66befc33c10476f5f3558ea79591a92b335', in 0.02 seconds)1682gitlab # [ 187.360753] gitaly[1362]: time="2026-07-25T09:19:53.947Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=348 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-25T09:20:03.162" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-07-25T09:19:53.942" grpc.time_ms=4.745 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1683gitlab # [ 187.363313] nixbot[3022]: INFO: ::ffff:127.0.0.1:50730 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f86ec66befc33c10476f5f3558ea79591a92b335 HTTP/1.1" 200 OK1684gitlab # [ 187.381929] gitaly[1362]: time="2026-07-25T09:19:53.968Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:20:03.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:53.963" grpc.time_ms=5.23 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1685gitlab # [ 187.397584] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 631686gitlab # [ 187.398313] nixbot[3022]: {"ts": "2026-07-25T09:19:53.985Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1687gitlab # [ 187.401768] nixbot[3022]: {"ts": "2026-07-25T09:19:53.988Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1688gitlab # [ 187.465295] gitaly[1362]: time="2026-07-25T09:19:54.052Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95VMWMD2Z14APVCNNWHW0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.045" grpc.time_ms=6.657 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc1689gitlab # [ 187.479333] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 531690gitlab # [ 187.509083] gitaly[1362]: time="2026-07-25T09:19:54.095Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-25T09:20:04.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:54.094" grpc.time_ms=0.728 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1691gitlab # [ 187.521316] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:54.107Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","277d40fa6b170e75a6656a6c527a3db7d4ccd1e0 f86ec66befc33c10476f5f3558ea79591a92b335 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5265b9e3ca9f2b30faa9fec5","created_at":"2026-07-25T09:19:53.741Z","trace_propagation_headers":{"sentry-trace":"a0c6c1d9bc6d4a8f873e37101ded82a8-9b7818c817504f51","baggage":"sentry-trace_id=a0c6c1d9bc6d4a8f873e37101ded82a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95TYCES06CAXGRFZJS14K","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:19:53.742Z","job_size_bytes":185,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5265b9e3ca9f2b30faa9fec5: done: 0.3636 sec","job_status":"done","queue_duration_s":0.001241,"scheduling_latency_s":0.001271,"gitaly_calls":7,"gitaly_duration_s":0.143211,"redis_calls":108,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.026664,"redis_read_bytes":349,"redis_write_bytes":12823,"redis_cache_calls":5,"redis_cache_duration_s":0.001053,"redis_cache_read_bytes":13,"redis_cache_write_bytes":347,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000293,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":323,"redis_queues_calls":8,"redis_queues_duration_s":0.00085,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6769,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001542,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.015032,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.007894,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.016,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.165028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002135746,"exclusive_lock_hold_duration_s":0.019028117,"duration_s":0.3636,"completed_at":"2026-07-25T09:19:54.107Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021875,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1692gitlab # [ 187.566099] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:54.110Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2e07b0f6ee58b1420b61a0c7","created_at":"2026-07-25T09:19:53.842Z","trace_propagation_headers":{"sentry-trace":"a0c6c1d9bc6d4a8f873e37101ded82a8-169d1a5900a547f4","baggage":"sentry-trace_id=a0c6c1d9bc6d4a8f873e37101ded82a8,sentry-release=Unknown"},"correlation_id":"01KYC95TYCES06CAXGRFZJS14K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:53.845Z","job_size_bytes":46,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2e07b0f6ee58b1420b61a0c7: start","job_status":"start","queue_duration_s":0.265238,"scheduling_latency_s":0.265257}1693gitlab # [ 187.566751] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:54.124Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2e07b0f6ee58b1420b61a0c7","created_at":"2026-07-25T09:19:53.842Z","trace_propagation_headers":{"sentry-trace":"a0c6c1d9bc6d4a8f873e37101ded82a8-169d1a5900a547f4","baggage":"sentry-trace_id=a0c6c1d9bc6d4a8f873e37101ded82a8,sentry-release=Unknown"},"correlation_id":"01KYC95TYCES06CAXGRFZJS14K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:53.845Z","job_size_bytes":46,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2e07b0f6ee58b1420b61a0c7: done: 0.013638 sec","job_status":"done","queue_duration_s":0.265238,"scheduling_latency_s":0.265257,"redis_calls":9,"redis_duration_s":0.001253,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000136,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000386,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013638,"completed_at":"2026-07-25T09:19:54.124Z","load_balancing_strategy":"primary","db_duration_s":0.001196,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1694gitlab # [ 187.631391] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:54.125Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"fbd0448201ffbea625eb8fa0","created_at":"2026-07-25T09:19:53.849Z","trace_propagation_headers":{"sentry-trace":"a0c6c1d9bc6d4a8f873e37101ded82a8-169d1a5900a547f4","baggage":"sentry-trace_id=a0c6c1d9bc6d4a8f873e37101ded82a8,sentry-release=Unknown"},"correlation_id":"01KYC95TYCES06CAXGRFZJS14K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:53.850Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-fbd0448201ffbea625eb8fa0: start","job_status":"start","queue_duration_s":0.274643,"scheduling_latency_s":0.274679}1695gitlab # [ 187.632247] gitlab-workhorse[1285]: time="2026-07-25T09:19:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491696gitlab # [ 187.632724] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 671697gitlab # [ 187.633498] gitaly[1362]: time="2026-07-25T09:19:54.133Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95VPMH3PNZW6BQSSW3MFB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.125" pid=1362 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1698gitlab # [ 187.634572] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:54.203Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"fbd0448201ffbea625eb8fa0","created_at":"2026-07-25T09:19:53.849Z","trace_propagation_headers":{"sentry-trace":"a0c6c1d9bc6d4a8f873e37101ded82a8-169d1a5900a547f4","baggage":"sentry-trace_id=a0c6c1d9bc6d4a8f873e37101ded82a8,sentry-release=Unknown"},"correlation_id":"01KYC95TYCES06CAXGRFZJS14K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:53.850Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-fbd0448201ffbea625eb8fa0: done: 0.07858 sec","job_status":"done","queue_duration_s":0.274643,"scheduling_latency_s":0.274679,"gitaly_calls":1,"gitaly_duration_s":0.044145,"redis_calls":12,"redis_duration_s":0.0038410000000000002,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002377,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000355,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.060165188,"duration_s":0.07858,"completed_at":"2026-07-25T09:19:54.203Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1699gitlab # [ 187.666879] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:54.205Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"27d9fb94293fdc4c05213813","created_at":"2026-07-25T09:19:54.001Z","trace_propagation_headers":{"sentry-trace":"a0c6c1d9bc6d4a8f873e37101ded82a8-169d1a5900a547f4","baggage":"sentry-trace_id=a0c6c1d9bc6d4a8f873e37101ded82a8,sentry-release=Unknown"},"correlation_id":"01KYC95TYCES06CAXGRFZJS14K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5b330d889f9f2ca668727351b09a09b5cd18eeae70548fa64d506bfa10563c14","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:54.002Z","job_size_bytes":467,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-27d9fb94293fdc4c05213813: start","job_status":"start","queue_duration_s":0.20231,"scheduling_latency_s":0.202328}1700gitlab # [ 187.683892] gitaly[1362]: time="2026-07-25T09:19:54.135Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=4 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95VPMH3PNZW6BQSSW3MFB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.125" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc1701gitlab # [ 187.740330] gitaly[1362]: time="2026-07-25T09:19:54.135Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=4 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95VPMH3PNZW6BQSSW3MFB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.125" grpc.time_ms=10.34 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc1702gitlab # [ 187.741192] gitaly[1362]: time="2026-07-25T09:19:54.184Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K diskcache=0b350b31-21ee-47bc-b501-7eea17d031f0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-25T15:19:54.142" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:54.143" pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1703gitlab # [ 187.741804] gitaly[1362]: time="2026-07-25T09:19:54.185Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1647 command.oublock=0 command.real_time_ms=46 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-25T15:19:54.142" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:54.143" grpc.time_ms=41.617 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1704gitlab # [ 187.742439] gitaly[1362]: time="2026-07-25T09:19:54.221Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:24.120" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:54.220" grpc.time_ms=0.573 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1705gitlab # [ 187.786755] gitaly[1362]: time="2026-07-25T09:19:54.229Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-25T09:20:04.132" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:54.223" grpc.time_ms=6.294 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1706gitlab # [ 187.787500] gitlab-workhorse[1285]: time="2026-07-25T09:19:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4191707gitlab # [ 187.787639] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 419 "" "git/2.54.0" 1961708gitlab # [ 187.788139] gitaly[1362]: time="2026-07-25T09:19:54.259Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:20:24.157" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:54.258" grpc.time_ms=0.831 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1709gitlab # [ 187.788778] gitaly[1362]: time="2026-07-25T09:19:54.263Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=57 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-25T09:20:24.161" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:54.261" grpc.time_ms=2.3 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1710gitlab # [ 187.789754] gitaly[1362]: time="2026-07-25T09:19:54.299Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:20:04.203" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:54.293" grpc.time_ms=5.871 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1711gitlab # [ 187.829595] gitaly[1362]: time="2026-07-25T09:19:54.331Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95VRV4PPT4YN02NNH49X3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.184" pid=1362 remote_ip="2001:db8:1::1" request_sha=3211837ee216502c272f746d90bde09480957d81 response_bytes=419 span.kind=server system=grpc1712gitlab # [ 187.830487] gitaly[1362]: time="2026-07-25T09:19:54.331Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1200 command.oublock=0 command.real_time_ms=144 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95VRV4PPT4YN02NNH49X3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.184" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc1713gitlab # [ 187.831153] gitaly[1362]: time="2026-07-25T09:19:54.336Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1200 command.oublock=0 command.real_time_ms=144 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95VRV4PPT4YN02NNH49X3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.184" grpc.time_ms=147.186 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc1714gitlab # [ 187.888066] gitaly[1362]: time="2026-07-25T09:19:54.474Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95W1VM69NPW84CQ1BYFYM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.468" grpc.time_ms=6.498 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc1715gitlab # [ 187.889629] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 481716gitlab # [ 187.958545] gitaly[1362]: time="2026-07-25T09:19:54.545Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95W3TMT946MRQN2QY8ATV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.537" pid=1362 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1717gitlab # [ 187.959583] gitaly[1362]: time="2026-07-25T09:19:54.545Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95W3TMT946MRQN2QY8ATV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.537" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc1718gitlab # [ 187.960809] gitaly[1362]: time="2026-07-25T09:19:54.547Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95W3TMT946MRQN2QY8ATV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.537" grpc.time_ms=8.176 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc1719gitlab # [ 187.998490] gitlab-workhorse[1285]: time="2026-07-25T09:19:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671720gitlab # [ 187.999294] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 951721gitlab # [ 188.075095] gitaly[1362]: time="2026-07-25T09:19:54.661Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC95W7NRBWD5DGWJ91HTT7G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.654" grpc.time_ms=7.384 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc1722gitlab # [ 188.077132] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 491723gitlab # [ 188.101967] gitaly[1362]: time="2026-07-25T09:19:54.688Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=958 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-25T09:20:24.578" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:54.678" grpc.time_ms=10.323 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1724gitlab # [ 188.126810] gitaly[1362]: time="2026-07-25T09:19:54.713Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95W9APYS1C042ZDHN3TM9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.702" pid=1362 remote_ip="2001:db8:1::1" request_sha=f1e6bb59289c4d43fc3699ed3fc4760ee01ef0e9 response_bytes=221 span.kind=server system=grpc1725gitlab # [ 188.129513] gitaly[1362]: time="2026-07-25T09:19:54.714Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1175 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95W9APYS1C042ZDHN3TM9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.702" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc1726gitlab # [ 188.129646] gitlab-workhorse[1285]: time="2026-07-25T09:19:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2211727gitlab # [ 188.134042] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.54.0" 481728gitlab # [ 188.134726] gitaly[1362]: time="2026-07-25T09:19:54.714Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1175 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95W9APYS1C042ZDHN3TM9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:19:54.702" grpc.time_ms=11.867 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc1729gitlab # [ 188.135558] gitaly[1362]: time="2026-07-25T09:19:54.717Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95TYCES06CAXGRFZJS14K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-25T09:20:24.607" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:54.707" grpc.time_ms=9.512 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1730gitlab # [ 188.173924] sidekiq-cluster[2071]: {"severity":"WARN","time":"2026-07-25T09:19:54.726Z","class":"CreatePipelineWorker","correlation_id":"01KYC95TYCES06CAXGRFZJS14K","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"277d40fa6b170e75a6656a6c527a3db7d4ccd1e0","after":"f86ec66befc33c10476f5f3558ea79591a92b335","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"f86ec66befc33c10476f5f3558ea79591a92b335","ref":"refs/heads/master"},"retry":0}1731gitlab # [ 188.174608] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:54.729Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"27d9fb94293fdc4c05213813","created_at":"2026-07-25T09:19:54.001Z","trace_propagation_headers":{"sentry-trace":"a0c6c1d9bc6d4a8f873e37101ded82a8-169d1a5900a547f4","baggage":"sentry-trace_id=a0c6c1d9bc6d4a8f873e37101ded82a8,sentry-release=Unknown"},"correlation_id":"01KYC95TYCES06CAXGRFZJS14K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5b330d889f9f2ca668727351b09a09b5cd18eeae70548fa64d506bfa10563c14","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:54.002Z","job_size_bytes":467,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-27d9fb94293fdc4c05213813: done: 0.524801 sec","job_status":"done","queue_duration_s":0.20231,"scheduling_latency_s":0.202328,"gitaly_calls":7,"gitaly_duration_s":0.073319,"redis_calls":33,"redis_duration_s":0.006293,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001054,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003865,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000646,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.386744,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.524801,"completed_at":"2026-07-25T09:19:54.729Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044979,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1732gitlab # [ 188.186113] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:54.730Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"7aca332e-d3b8-40c0-8ad1-498325873751\"}"],"class":"WebHookWorker","jid":"45ca4b4e0b8bfbf349833c67","created_at":"2026-07-25T09:19:54.083Z","trace_propagation_headers":{"sentry-trace":"a0c6c1d9bc6d4a8f873e37101ded82a8-169d1a5900a547f4","baggage":"sentry-trace_id=a0c6c1d9bc6d4a8f873e37101ded82a8,sentry-release=Unknown"},"correlation_id":"01KYC95TYCES06CAXGRFZJS14K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a3d466f120755e51c7d20f4734457357f782a7500a182c22fc63b36489a56e3b","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:54.087Z","job_size_bytes":1749,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-45ca4b4e0b8bfbf349833c67: start","job_status":"start","queue_duration_s":0.643626,"scheduling_latency_s":0.643644}1733gitlab # [ 188.242357] nixbot[3022]: INFO: ::ffff:127.0.0.1:50732 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1734gitlab # [ 188.254830] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:54.841Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"7aca332e-d3b8-40c0-8ad1-498325873751\"}"],"class":"WebHookWorker","jid":"45ca4b4e0b8bfbf349833c67","created_at":"2026-07-25T09:19:54.083Z","trace_propagation_headers":{"sentry-trace":"a0c6c1d9bc6d4a8f873e37101ded82a8-169d1a5900a547f4","baggage":"sentry-trace_id=a0c6c1d9bc6d4a8f873e37101ded82a8,sentry-release=Unknown"},"correlation_id":"01KYC95TYCES06CAXGRFZJS14K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a3d466f120755e51c7d20f4734457357f782a7500a182c22fc63b36489a56e3b","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:54.087Z","job_size_bytes":1749,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-45ca4b4e0b8bfbf349833c67: done: 0.110413 sec","job_status":"done","queue_duration_s":0.643626,"scheduling_latency_s":0.643644,"redis_calls":19,"redis_duration_s":0.002672,"redis_read_bytes":31,"redis_write_bytes":5282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000593,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000229,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3644,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001167,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000683,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.04484257100000377,"cpu_s":0.055177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025562,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.110413,"completed_at":"2026-07-25T09:19:54.841Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001605,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1735gitlab # [ 188.258651] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:54.843Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","45ca4b4e0b8bfbf349833c67"],"class":"WebHooks::LogExecutionWorker","jid":"e70cc9534e5ea299c5a57b8b","created_at":"2026-07-25T09:19:54.831Z","trace_propagation_headers":{"sentry-trace":"a0c6c1d9bc6d4a8f873e37101ded82a8-7c12657d330e4cfe","baggage":"sentry-trace_id=a0c6c1d9bc6d4a8f873e37101ded82a8,sentry-release=Unknown"},"correlation_id":"01KYC95TYCES06CAXGRFZJS14K","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:15c2319b6e5456737645effaf83eb454631ec9729d93d5ab1bd135edf20a2f63","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:54.836Z","job_size_bytes":2507,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-e70cc9534e5ea299c5a57b8b: start","job_status":"start","queue_duration_s":0.006958,"scheduling_latency_s":0.006974}1736gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f86ec66befc33c10476f5f3558ea79591a92b335'1737gitlab # [ 188.353277] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:54.939Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","45ca4b4e0b8bfbf349833c67"],"class":"WebHooks::LogExecutionWorker","jid":"e70cc9534e5ea299c5a57b8b","created_at":"2026-07-25T09:19:54.831Z","trace_propagation_headers":{"sentry-trace":"a0c6c1d9bc6d4a8f873e37101ded82a8-7c12657d330e4cfe","baggage":"sentry-trace_id=a0c6c1d9bc6d4a8f873e37101ded82a8,sentry-release=Unknown"},"correlation_id":"01KYC95TYCES06CAXGRFZJS14K","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:15c2319b6e5456737645effaf83eb454631ec9729d93d5ab1bd135edf20a2f63","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:54.836Z","job_size_bytes":2507,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-e70cc9534e5ea299c5a57b8b: done: 0.096571 sec","job_status":"done","queue_duration_s":0.006958,"scheduling_latency_s":0.006974,"redis_calls":10,"redis_duration_s":0.002567,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001428,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000831,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.022,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.022,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210642,"duration_s":0.096571,"completed_at":"2026-07-25T09:19:54.939Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006573,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1738gitlab # [ 188.398091] nixbot[3022]: INFO: ::ffff:127.0.0.1:50744 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f86ec66befc33c10476f5f3558ea79591a92b335 HTTP/1.1" 200 OK1739gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f86ec66befc33c10476f5f3558ea79591a92b335', in 0.04 seconds)1740(finished: subtest: push delivers the webhook, in 1.88 seconds)1741subtest: eval and build post commit statuses1742gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses1743gitlab # [ 188.413599] gitaly[1362]: time="2026-07-25T09:19:55.000Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95WH14T0N29TSDESDMW1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:24.599" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:54.999" grpc.time_ms=0.511 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1744gitlab # [ 188.445377] gitaly[1362]: time="2026-07-25T09:19:55.032Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95WH14T0N29TSDESDMW1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-25T09:20:25.024" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:55.025" grpc.time_ms=6.816 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745gitlab # [ 188.456197] gitaly[1362]: time="2026-07-25T09:19:55.043Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95WH14T0N29TSDESDMW1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:20:05.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:55.037" grpc.time_ms=5.044 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1746gitlab # [ 188.473112] gitaly[1362]: time="2026-07-25T09:19:55.059Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95WM5BK4C65YFJJ83EF3V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:25.058" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:55.059" grpc.time_ms=0.435 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747gitlab # [ 188.516405] gitaly[1362]: time="2026-07-25T09:19:55.103Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95WH14T0N29TSDESDMW1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-25T09:20:05.072" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:55.102" grpc.time_ms=0.301 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1748gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses, in 0.13 seconds)1749gitlab # [ 188.527817] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses HTTP/1.1" 200 2 "" "curl/8.20.0" 1001750gitlab # [ 188.528472] gitaly[1362]: time="2026-07-25T09:19:55.114Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95WH14T0N29TSDESDMW1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-25T09:20:05.078" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:19:55.108" grpc.time_ms=6.201 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1751gitlab # [ 188.577220] gitaly[1362]: time="2026-07-25T09:19:55.163Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95WH14T0N29TSDESDMW1H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:55.163" grpc.time_ms=0.453 pid=1362 span.kind=server system=grpc1752gitlab # [ 188.604258] gitaly[1362]: time="2026-07-25T09:19:55.191Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC95WH14T0N29TSDESDMW1H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4161 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:19:55.190" grpc.time_ms=0.355 pid=1362 span.kind=server system=grpc1753gitlab # [ 188.623759] gitaly[1362]: time="2026-07-25T09:19:55.210Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC95WH14T0N29TSDESDMW1H diskcache=85041a50-07e2-4351-9b43-8ad2d0d64389 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T09:20:05.100" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:55.130" pid=1362 ref=refs/keep-around/f86ec66befc33c10476f5f3558ea79591a92b335 remote_ip="2001:db8:1::1" revision=f86ec66befc33c10476f5f3558ea79591a92b335 span.kind=server system=grpc username=root1754gitlab # [ 188.634221] gitaly[1362]: time="2026-07-25T09:19:55.221Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=63 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5475 command.oublock=8 command.real_time_ms=69 command.spawn_token_fork_ms=0 command.system_time_ms=38 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95WH14T0N29TSDESDMW1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T09:20:05.100" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:19:55.130" grpc.time_ms=79.847 pid=1362 ref=refs/keep-around/f86ec66befc33c10476f5f3558ea79591a92b335 remote_ip="2001:db8:1::1" revision=f86ec66befc33c10476f5f3558ea79591a92b335 span.kind=server system=grpc username=root1755gitlab # [ 188.650894] gitaly[1362]: time="2026-07-25T09:19:55.237Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95WH14T0N29TSDESDMW1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:25.236" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:55.237" grpc.time_ms=0.485 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1756gitlab # [ 188.680452] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:55.265Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4172bd29fc391c0aa0fb8a87","created_at":"2026-07-25T09:19:55.254Z","trace_propagation_headers":{"sentry-trace":"df57f045e8654201b26186282caf8b6f-4f3f942099f842b6","baggage":"sentry-trace_id=df57f045e8654201b26186282caf8b6f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95WH14T0N29TSDESDMW1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:55.263Z","job_size_bytes":65,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4172bd29fc391c0aa0fb8a87: start","job_status":"start","queue_duration_s":0.002055,"scheduling_latency_s":0.002107}1757gitlab # [ 188.751850] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:55.338Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4172bd29fc391c0aa0fb8a87","created_at":"2026-07-25T09:19:55.254Z","trace_propagation_headers":{"sentry-trace":"df57f045e8654201b26186282caf8b6f-4f3f942099f842b6","baggage":"sentry-trace_id=df57f045e8654201b26186282caf8b6f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95WH14T0N29TSDESDMW1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:55.263Z","job_size_bytes":65,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4172bd29fc391c0aa0fb8a87: done: 0.072388 sec","job_status":"done","queue_duration_s":0.002055,"scheduling_latency_s":0.002107,"redis_calls":19,"redis_duration_s":0.0062120000000000005,"redis_read_bytes":145,"redis_write_bytes":2300,"redis_feature_flag_calls":11,"redis_feature_flag_duration_s":0.003354,"redis_feature_flag_read_bytes":138,"redis_feature_flag_write_bytes":1482,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002256,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000602,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000433016,"duration_s":0.072388,"completed_at":"2026-07-25T09:19:55.338Z","load_balancing_strategy":"primary","db_duration_s":0.013853,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1758gitlab # [ 188.756422] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:55.340Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2f119ae057f5fc743cd67454","created_at":"2026-07-25T09:19:55.264Z","trace_propagation_headers":{"sentry-trace":"df57f045e8654201b26186282caf8b6f-4f3f942099f842b6","baggage":"sentry-trace_id=df57f045e8654201b26186282caf8b6f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95WH14T0N29TSDESDMW1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:55.273Z","job_size_bytes":65,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2f119ae057f5fc743cd67454: start","job_status":"start","queue_duration_s":0.067,"scheduling_latency_s":0.067026}1759gitlab # [ 188.805160] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:55.390Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2f119ae057f5fc743cd67454","created_at":"2026-07-25T09:19:55.264Z","trace_propagation_headers":{"sentry-trace":"df57f045e8654201b26186282caf8b6f-4f3f942099f842b6","baggage":"sentry-trace_id=df57f045e8654201b26186282caf8b6f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95WH14T0N29TSDESDMW1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:55.273Z","job_size_bytes":65,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2f119ae057f5fc743cd67454: done: 0.050095 sec","job_status":"done","queue_duration_s":0.067,"scheduling_latency_s":0.067026,"redis_calls":15,"redis_duration_s":0.003356,"redis_read_bytes":142,"redis_write_bytes":1431,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":431,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001185,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001771,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000265676,"duration_s":0.050095,"completed_at":"2026-07-25T09:19:55.390Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011516,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1760gitlab # [ 188.820429] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:55.407Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"1fc0c278fb816f74cdaac165","created_at":"2026-07-25T09:19:55.401Z","trace_propagation_headers":{"sentry-trace":"df57f045e8654201b26186282caf8b6f-4f3f942099f842b6","baggage":"sentry-trace_id=df57f045e8654201b26186282caf8b6f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95WH14T0N29TSDESDMW1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:55.406Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1fc0c278fb816f74cdaac165: start","job_status":"start","queue_duration_s":0.000752,"scheduling_latency_s":0.00077}1761gitlab # [ 188.838920] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f86ec66befc33c10476f5f3558ea79591a92b335 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5121762gitlab # [ 188.876400] nixbot[3022]: {"ts": "2026-07-25T09:19:55.463Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f86ec66befc33c10476f5f3558ea79591a92b335 \"HTTP/1.1 201 Created\""}1763gitlab # [ 188.883351] nixbot[3022]: {"ts": "2026-07-25T09:19:55.470Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-f86ec66befc3-6efa89c7", "argv0": "bwrap"}1764gitlab # [ 188.891357] gitaly[1362]: time="2026-07-25T09:19:55.478Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC95WH14T0N29TSDESDMW1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:20:25.377" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:55.477" grpc.time_ms=0.776 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 188.919084] gitaly[1362]: time="2026-07-25T09:19:55.505Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95WH14T0N29TSDESDMW1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:25.404" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:55.505" grpc.time_ms=0.491 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 188.941750] gitaly[1362]: time="2026-07-25T09:19:55.528Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95WH14T0N29TSDESDMW1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:25.427" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:55.527" grpc.time_ms=0.643 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 188.963544] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:55.549Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"1fc0c278fb816f74cdaac165","created_at":"2026-07-25T09:19:55.401Z","trace_propagation_headers":{"sentry-trace":"df57f045e8654201b26186282caf8b6f-4f3f942099f842b6","baggage":"sentry-trace_id=df57f045e8654201b26186282caf8b6f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC95WH14T0N29TSDESDMW1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:55.406Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1fc0c278fb816f74cdaac165: done: 0.142841 sec","job_status":"done","queue_duration_s":0.000752,"scheduling_latency_s":0.00077,"gitaly_calls":3,"gitaly_duration_s":0.01845,"redis_calls":53,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007755,"redis_read_bytes":235,"redis_write_bytes":7156,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000743,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001871,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.001521,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":2,"redis_queues_duration_s":0.000198,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1131,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001217,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000376,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":165,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.00033,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000756,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08891,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.118618149,"duration_s":0.142841,"completed_at":"2026-07-25T09:19:55.549Z","load_balancing_strategy":"primary","db_duration_s":0.031559,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1768gitlab # [ 188.976650] systemd[1]: Started Nix Daemon.1769gitlab # [ 189.013253] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:55.599Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"9c9fb25d7bcaeede40683bab","created_at":"2026-07-25T09:19:55.459Z","trace_propagation_headers":{"sentry-trace":"df57f045e8654201b26186282caf8b6f-71673f2fe0ad4ebd","baggage":"sentry-trace_id=df57f045e8654201b26186282caf8b6f,sentry-release=Unknown"},"correlation_id":"01KYC95WH14T0N29TSDESDMW1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:55.462Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9c9fb25d7bcaeede40683bab: start","job_status":"start","queue_duration_s":0.137668,"scheduling_latency_s":0.1377}1770gitlab # [ 189.041435] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:19:55.628Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"9c9fb25d7bcaeede40683bab","created_at":"2026-07-25T09:19:55.459Z","trace_propagation_headers":{"sentry-trace":"df57f045e8654201b26186282caf8b6f-71673f2fe0ad4ebd","baggage":"sentry-trace_id=df57f045e8654201b26186282caf8b6f,sentry-release=Unknown"},"correlation_id":"01KYC95WH14T0N29TSDESDMW1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T09:19:55.462Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9c9fb25d7bcaeede40683bab: done: 0.028384 sec","job_status":"done","queue_duration_s":0.137668,"scheduling_latency_s":0.1377,"redis_calls":10,"redis_duration_s":0.001575,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000311,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022852,"duration_s":0.028384,"completed_at":"2026-07-25T09:19:55.627Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003511,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1771gitlab # [ 189.063160] nix-daemon[3316]: accepted connection from pid 3314, user nixbot1772gitlab # [ 189.063867] nix-daemon[3316]: accepted connection from pid 3315, user nixbot1773gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses1774gitlab # [ 189.636739] gitaly[1362]: time="2026-07-25T09:19:56.222Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95XQZX4GRX15F6B9695E3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:26.220" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:56.221" grpc.time_ms=0.94 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 189.673127] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 981776gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses, in 0.15 seconds)1777gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses1778gitlab # [ 190.750737] gitaly[1362]: time="2026-07-25T09:19:57.336Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95YVQ0XZT1FXZ89RBN169 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:27.335" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:57.335" grpc.time_ms=0.953 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1779gitlab # [ 190.767641] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 501780gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses, in 0.10 seconds)1781gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses1782gitlab # [ 191.885158] gitaly[1362]: time="2026-07-25T09:19:58.471Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC95ZY7QG0JTWEVJX65MJDD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:28.069" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:58.469" grpc.time_ms=0.987 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1783gitlab # [ 191.913294] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 911784gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses, in 0.13 seconds)1785gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses1786gitlab # [ 193.015453] gitaly[1362]: time="2026-07-25T09:19:59.601Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC9611N5W077EC7WA1ATXBF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:29.199" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:19:59.600" grpc.time_ms=0.896 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787gitlab # [ 193.039943] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:19:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 831788gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses, in 0.13 seconds)1789gitlab # [ 193.387168] nix-daemon[3316]: accepted connection from pid 3353, user nixbot1790gitlab # [ 193.432731] gitaly[1362]: time="2026-07-25T09:20:00.019Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC961EBPGSAMRAD9AY9Y9FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:30.011" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:00.012" grpc.time_ms=6.109 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 193.473907] gitaly[1362]: time="2026-07-25T09:20:00.060Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC961EBPGSAMRAD9AY9Y9FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:20:10.019" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:20:00.050" grpc.time_ms=10.494 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 193.514600] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.100Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"dd7635a1e85654cbb4017c19","created_at":"2026-07-25T09:20:00.095Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-e908ec1fa3864290","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.098Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dd7635a1e85654cbb4017c19: start","job_status":"start","queue_duration_s":0.0018,"scheduling_latency_s":0.00185}1793gitlab # [ 193.525274] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:20:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f86ec66befc33c10476f5f3558ea79591a92b335 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1631794gitlab # [ 193.527099] nixbot[3022]: {"ts": "2026-07-25T09:20:00.112Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f86ec66befc33c10476f5f3558ea79591a92b335 \"HTTP/1.1 201 Created\""}1795gitlab # [ 193.602356] gitaly[1362]: time="2026-07-25T09:20:00.189Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC961KJ7RVCG0ST7EG2GQWJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:30.188" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:00.188" grpc.time_ms=0.5 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1796gitlab # [ 193.667149] gitaly[1362]: time="2026-07-25T09:20:00.253Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC961EBPGSAMRAD9AY9Y9FP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:20:00.252" grpc.time_ms=0.291 pid=1362 span.kind=server system=grpc1797gitlab # [ 193.693073] gitaly[1362]: time="2026-07-25T09:20:00.279Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC961EBPGSAMRAD9AY9Y9FP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:20:00.279" grpc.time_ms=0.346 pid=1362 span.kind=server system=grpc1798gitlab # [ 193.717882] gitaly[1362]: time="2026-07-25T09:20:00.304Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC961EBPGSAMRAD9AY9Y9FP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:20:00.304" grpc.time_ms=0.225 pid=1362 span.kind=server system=grpc1799gitlab # [ 193.720334] gitaly[1362]: time="2026-07-25T09:20:00.307Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC961KJ7RVCG0ST7EG2GQWJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:20:10.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:20:00.300" grpc.time_ms=6.725 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 193.746891] gitaly[1362]: time="2026-07-25T09:20:00.333Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC961EBPGSAMRAD9AY9Y9FP diskcache=def1ead6-36fd-4572-bcaf-4b4ca4646b76 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T09:20:30.125" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:20:00.225" pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 193.756086] gitaly[1362]: time="2026-07-25T09:20:00.342Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=104 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7375 command.oublock=0 command.real_time_ms=99 command.spawn_token_fork_ms=0 command.system_time_ms=77 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01KYC961EBPGSAMRAD9AY9Y9FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T09:20:30.125" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:20:00.225" grpc.time_ms=107.917 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1802gitlab # [ 193.814952] gitaly[1362]: time="2026-07-25T09:20:00.401Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC961EBPGSAMRAD9AY9Y9FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:20:30.300" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:00.401" grpc.time_ms=0.69 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 193.816335] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:20:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f86ec66befc33c10476f5f3558ea79591a92b335 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2871804gitlab # [ 193.817141] nixbot[3022]: {"ts": "2026-07-25T09:20:00.403Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f86ec66befc33c10476f5f3558ea79591a92b335 \"HTTP/1.1 201 Created\""}1805gitlab # [ 193.833168] gitaly[1362]: time="2026-07-25T09:20:00.420Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC961EBPGSAMRAD9AY9Y9FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:30.319" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:00.419" grpc.time_ms=0.438 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 193.881158] gitaly[1362]: time="2026-07-25T09:20:00.467Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC961EBPGSAMRAD9AY9Y9FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:30.366" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:00.467" grpc.time_ms=0.59 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 193.900172] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.486Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"6b6933f3d1695ead23cfecbd","created_at":"2026-07-25T09:20:00.484Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"dd7635a1e85654cbb4017c19","job_size_bytes":3,"pid":2071,"job_status":"deduplicated","message":"PipelineProcessWorker JID-6b6933f3d1695ead23cfecbd: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1808gitlab # [ 193.918505] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.504Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"dd7635a1e85654cbb4017c19","created_at":"2026-07-25T09:20:00.095Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-e908ec1fa3864290","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.098Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2071,"job_status":"rescheduled","message":"PipelineProcessWorker JID-dd7635a1e85654cbb4017c19: rescheduled"}1809gitlab # [ 193.942068] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.527Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"dd7635a1e85654cbb4017c19","created_at":"2026-07-25T09:20:00.095Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-e908ec1fa3864290","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.098Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dd7635a1e85654cbb4017c19: done: 0.427079 sec","job_status":"done","queue_duration_s":0.0018,"scheduling_latency_s":0.00185,"gitaly_calls":4,"gitaly_duration_s":0.148786,"redis_calls":128,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.037335,"redis_read_bytes":927,"redis_write_bytes":28561,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001186,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001927,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_feature_flag_calls":37,"redis_feature_flag_duration_s":0.009957,"redis_feature_flag_read_bytes":672,"redis_feature_flag_write_bytes":5736,"redis_queues_calls":25,"redis_queues_duration_s":0.002818,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14467,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.017572,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000461,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000445,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001783,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.069,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":37,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.16464,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.343401745,"duration_s":0.427079,"completed_at":"2026-07-25T09:20:00.527Z","load_balancing_strategy":"primary","db_duration_s":0.073355,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1810gitlab # [ 193.991385] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.577Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b1b62d4d2bc497d89e051ac1","created_at":"2026-07-25T09:20:00.187Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.194Z","job_size_bytes":23,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b1b62d4d2bc497d89e051ac1: start","job_status":"start","queue_duration_s":0.383053,"scheduling_latency_s":0.383104}1811gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses1812gitlab # [ 194.116847] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.703Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b1b62d4d2bc497d89e051ac1","created_at":"2026-07-25T09:20:00.187Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.194Z","job_size_bytes":23,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b1b62d4d2bc497d89e051ac1: done: 0.125676 sec","job_status":"done","queue_duration_s":0.383053,"scheduling_latency_s":0.383104,"redis_calls":10,"redis_duration_s":0.003242,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000403,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00064,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000470731,"duration_s":0.125676,"completed_at":"2026-07-25T09:20:00.703Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018893,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1813gitlab # [ 194.119733] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.704Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5adeaa83dde0b95dc8f377b7","created_at":"2026-07-25T09:20:00.348Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.352Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5adeaa83dde0b95dc8f377b7: start","job_status":"start","queue_duration_s":0.352705,"scheduling_latency_s":0.352732}1814gitlab # [ 194.186102] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.735Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5adeaa83dde0b95dc8f377b7","created_at":"2026-07-25T09:20:00.348Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.352Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5adeaa83dde0b95dc8f377b7: done: 0.030749 sec","job_status":"done","queue_duration_s":0.352705,"scheduling_latency_s":0.352732,"redis_calls":10,"redis_duration_s":0.0024619999999999998,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000512,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001478,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000472,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000318476,"duration_s":0.030749,"completed_at":"2026-07-25T09:20:00.735Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004862,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1815gitlab # [ 194.199600] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.736Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6cca5bbc134e4eb200836754","created_at":"2026-07-25T09:20:00.363Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.369Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6cca5bbc134e4eb200836754: start","job_status":"start","queue_duration_s":0.367048,"scheduling_latency_s":0.367062}1816gitlab # [ 194.252738] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.838Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6cca5bbc134e4eb200836754","created_at":"2026-07-25T09:20:00.363Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.369Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6cca5bbc134e4eb200836754: done: 0.102098 sec","job_status":"done","queue_duration_s":0.367048,"scheduling_latency_s":0.367062,"redis_calls":10,"redis_duration_s":0.002383,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000404,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001492,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000487,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.07,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.07,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000490006,"duration_s":0.102098,"completed_at":"2026-07-25T09:20:00.838Z","load_balancing_strategy":"primary","db_duration_s":0.06991,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1817gitlab # [ 194.254614] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.841Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1cf3e7eaf6882e89697d29ff","created_at":"2026-07-25T09:20:00.379Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.383Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1cf3e7eaf6882e89697d29ff: start","job_status":"start","queue_duration_s":0.457923,"scheduling_latency_s":0.458019}1818gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses, in 0.29 seconds)1819gitlab # [ 194.299543] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.885Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1cf3e7eaf6882e89697d29ff","created_at":"2026-07-25T09:20:00.379Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.383Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1cf3e7eaf6882e89697d29ff: done: 0.044684 sec","job_status":"done","queue_duration_s":0.457923,"scheduling_latency_s":0.458019,"redis_calls":13,"redis_duration_s":0.003785,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000733,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000651,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000917994,"duration_s":0.044684,"completed_at":"2026-07-25T09:20:00.885Z","load_balancing_strategy":"primary","db_duration_s":0.005252,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1820gitlab # [ 194.308387] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.892Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8d7025a22229cfb7085147a6","created_at":"2026-07-25T09:20:00.383Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.386Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8d7025a22229cfb7085147a6: start","job_status":"start","queue_duration_s":0.505546,"scheduling_latency_s":0.505583}1821gitlab # [ 194.323516] gitaly[1362]: time="2026-07-25T09:20:00.894Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC96256GMR4EEK2M8XP0TS9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:30.492" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:00.892" grpc.time_ms=1.207 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1822gitlab # [ 194.368072] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:20:00 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 2371823gitlab # [ 194.368767] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.933Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8d7025a22229cfb7085147a6","created_at":"2026-07-25T09:20:00.383Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.386Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8d7025a22229cfb7085147a6: done: 0.041561 sec","job_status":"done","queue_duration_s":0.505546,"scheduling_latency_s":0.505583,"redis_calls":10,"redis_duration_s":0.0046040000000000005,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001424,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001778,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001402,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000259251,"duration_s":0.041561,"completed_at":"2026-07-25T09:20:00.933Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003782,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1824gitlab # [ 194.376171] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.934Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a58157c67c70194620f97224","created_at":"2026-07-25T09:20:00.386Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.389Z","job_size_bytes":19,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a58157c67c70194620f97224: start","job_status":"start","queue_duration_s":0.545093,"scheduling_latency_s":0.545107}1825gitlab # [ 194.425144] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.953Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a58157c67c70194620f97224","created_at":"2026-07-25T09:20:00.386Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.389Z","job_size_bytes":19,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a58157c67c70194620f97224: done: 0.019335 sec","job_status":"done","queue_duration_s":0.545093,"scheduling_latency_s":0.545107,"redis_calls":11,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191924,"duration_s":0.019335,"completed_at":"2026-07-25T09:20:00.953Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1826gitlab # [ 194.430672] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.954Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3a51367fa3e267c4ac3626bb","created_at":"2026-07-25T09:20:00.391Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.394Z","job_size_bytes":66,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3a51367fa3e267c4ac3626bb: start","job_status":"start","queue_duration_s":0.560535,"scheduling_latency_s":0.560549}1827gitlab # [ 194.478094] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.973Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3a51367fa3e267c4ac3626bb","created_at":"2026-07-25T09:20:00.391Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.394Z","job_size_bytes":66,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3a51367fa3e267c4ac3626bb: done: 0.01869 sec","job_status":"done","queue_duration_s":0.560535,"scheduling_latency_s":0.560549,"redis_calls":10,"redis_duration_s":0.0017180000000000001,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000336,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000352,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231035,"duration_s":0.01869,"completed_at":"2026-07-25T09:20:00.973Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003593,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1828gitlab # [ 194.522155] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.974Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c5c685f05c3f119a4a3c9086","created_at":"2026-07-25T09:20:00.394Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.395Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c5c685f05c3f119a4a3c9086: start","job_status":"start","queue_duration_s":0.578539,"scheduling_latency_s":0.578552}1829gitlab # [ 194.522811] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.993Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c5c685f05c3f119a4a3c9086","created_at":"2026-07-25T09:20:00.394Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.395Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c5c685f05c3f119a4a3c9086: done: 0.01886 sec","job_status":"done","queue_duration_s":0.578539,"scheduling_latency_s":0.578552,"redis_calls":7,"redis_duration_s":0.001387,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000542,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01886,"completed_at":"2026-07-25T09:20:00.993Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003007,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1830gitlab # [ 194.537719] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:00.994Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5e16e7ab5e234d14c5e3ee83","created_at":"2026-07-25T09:20:00.438Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.441Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5e16e7ab5e234d14c5e3ee83: start","job_status":"start","queue_duration_s":0.553039,"scheduling_latency_s":0.553054}1831gitlab # [ 194.552774] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.018Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5e16e7ab5e234d14c5e3ee83","created_at":"2026-07-25T09:20:00.438Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.441Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5e16e7ab5e234d14c5e3ee83: done: 0.023976 sec","job_status":"done","queue_duration_s":0.553039,"scheduling_latency_s":0.553054,"redis_calls":10,"redis_duration_s":0.001687,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000327,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000245283,"duration_s":0.023976,"completed_at":"2026-07-25T09:20:01.018Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007954,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1832gitlab # [ 194.617500] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.019Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"eab369ca5fca6fdf397a0f5e","created_at":"2026-07-25T09:20:00.441Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.444Z","job_size_bytes":6,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-eab369ca5fca6fdf397a0f5e: start","job_status":"start","queue_duration_s":0.575258,"scheduling_latency_s":0.575271}1833gitlab # [ 194.618204] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.037Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"eab369ca5fca6fdf397a0f5e","created_at":"2026-07-25T09:20:00.441Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.444Z","job_size_bytes":6,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-eab369ca5fca6fdf397a0f5e: done: 0.018061 sec","job_status":"done","queue_duration_s":0.575258,"scheduling_latency_s":0.575271,"redis_calls":10,"redis_duration_s":0.0018340000000000001,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000388,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000354,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000267353,"duration_s":0.018061,"completed_at":"2026-07-25T09:20:01.037Z","load_balancing_strategy":"primary","db_duration_s":0.002253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1834gitlab # [ 194.668858] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.038Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"688a4d9d764433542506a2e8","created_at":"2026-07-25T09:20:00.444Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.447Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-688a4d9d764433542506a2e8: start","job_status":"start","queue_duration_s":0.591341,"scheduling_latency_s":0.591356}1835gitlab # [ 194.669508] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.061Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"688a4d9d764433542506a2e8","created_at":"2026-07-25T09:20:00.444Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.447Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-688a4d9d764433542506a2e8: done: 0.022692 sec","job_status":"done","queue_duration_s":0.591341,"scheduling_latency_s":0.591356,"redis_calls":10,"redis_duration_s":0.0017540000000000001,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000352,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000382,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000235784,"duration_s":0.022692,"completed_at":"2026-07-25T09:20:01.061Z","load_balancing_strategy":"primary","db_duration_s":0.004629,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1836gitlab # [ 194.716146] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.062Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"3a866d700277bc594e6395c8","created_at":"2026-07-25T09:20:00.505Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.520Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3a866d700277bc594e6395c8: start","job_status":"start","queue_duration_s":0.542136,"scheduling_latency_s":0.542149}1837gitlab # [ 194.716846] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.175Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"3a866d700277bc594e6395c8","created_at":"2026-07-25T09:20:00.505Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-f003563d5d12478a","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:00.520Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3a866d700277bc594e6395c8: done: 0.112808 sec","job_status":"done","queue_duration_s":0.542136,"scheduling_latency_s":0.542149,"gitaly_calls":3,"gitaly_duration_s":0.010661,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.0057209999999999995,"redis_read_bytes":98,"redis_write_bytes":6013,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.0006,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001718,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000187,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001194,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00017,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000507,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000745,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":20,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076757,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.094965421,"duration_s":0.112808,"completed_at":"2026-07-25T09:20:01.175Z","load_balancing_strategy":"primary","db_duration_s":0.025773,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1838gitlab # [ 194.779230] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.176Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"a47d8e2f47321af999498a76","created_at":"2026-07-25T09:20:01.098Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-6a90b292347f4b33","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.100Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a47d8e2f47321af999498a76: start","job_status":"start","queue_duration_s":0.076123,"scheduling_latency_s":0.076139}1839gitlab # [ 194.779925] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.194Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"a47d8e2f47321af999498a76","created_at":"2026-07-25T09:20:01.098Z","trace_propagation_headers":{"sentry-trace":"ee4ce8d22bc64a7e9b306d5b450d8163-6a90b292347f4b33","baggage":"sentry-trace_id=ee4ce8d22bc64a7e9b306d5b450d8163,sentry-release=Unknown"},"correlation_id":"01KYC961EBPGSAMRAD9AY9Y9FP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.100Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a47d8e2f47321af999498a76: done: 0.018385 sec","job_status":"done","queue_duration_s":0.076123,"scheduling_latency_s":0.076139,"redis_calls":7,"redis_duration_s":0.000918,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000668,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018385,"completed_at":"2026-07-25T09:20:01.194Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002499,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1840gitlab # [ 194.808971] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"503cd7cbdefb59eec1023b7f","created_at":"2026-07-25T09:20:01.246Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"650b5b47dd96efac3f68d6859cb2c5be","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.251Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-503cd7cbdefb59eec1023b7f: start","job_status":"start","queue_duration_s":0.001059,"scheduling_latency_s":0.00109}1841gitlab # [ 194.822255] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.281Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"503cd7cbdefb59eec1023b7f","created_at":"2026-07-25T09:20:01.246Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"650b5b47dd96efac3f68d6859cb2c5be","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.251Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-503cd7cbdefb59eec1023b7f: done: 0.028672 sec","job_status":"done","queue_duration_s":0.001059,"scheduling_latency_s":0.00109,"redis_calls":9,"redis_duration_s":0.004003,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002896,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000604266,"exclusive_lock_hold_duration_s":0.003182248,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.028672,"completed_at":"2026-07-25T09:20:01.281Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00158,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1842gitlab # [ 194.862992] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.286Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"79a0400733f8faacfd958706","created_at":"2026-07-25T09:20:01.259Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a176143411cddf34e2335e98516ea4f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.261Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-79a0400733f8faacfd958706: start","job_status":"start","queue_duration_s":0.024747,"scheduling_latency_s":0.024765}1843gitlab # [ 194.873233] gitaly[1362]: time="2026-07-25T09:20:01.108Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC961EBPGSAMRAD9AY9Y9FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:20:31.006" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:01.107" grpc.time_ms=0.821 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1844gitlab # [ 194.915730] gitaly[1362]: time="2026-07-25T09:20:01.131Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC961EBPGSAMRAD9AY9Y9FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:31.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:01.130" grpc.time_ms=0.821 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1845gitlab # [ 194.916542] gitaly[1362]: time="2026-07-25T09:20:01.163Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC961EBPGSAMRAD9AY9Y9FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:31.062" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:01.162" grpc.time_ms=0.603 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1846gitlab # [ 195.034171] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"79a0400733f8faacfd958706","created_at":"2026-07-25T09:20:01.259Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a176143411cddf34e2335e98516ea4f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.261Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-79a0400733f8faacfd958706: done: 0.33404 sec","job_status":"done","queue_duration_s":0.024747,"scheduling_latency_s":0.024765,"redis_calls":11,"redis_duration_s":0.006406,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000917,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002769,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00272,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":124,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":124,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.074,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":124,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":80,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.074,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000388039,"exclusive_lock_hold_duration_s":0.30113073,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.33404,"completed_at":"2026-07-25T09:20:01.620Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.22221,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1847gitlab # [ 195.079832] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.666Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ceaa2758d84f7aaf7fecde56","created_at":"2026-07-25T09:20:01.269Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7af4f2c1c5182aebccc71fe516d37a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.271Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ceaa2758d84f7aaf7fecde56: start","job_status":"start","queue_duration_s":0.394627,"scheduling_latency_s":0.394659}1848gitlab # [ 195.121460] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.708Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1849gitlab # [ 195.135744] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ceaa2758d84f7aaf7fecde56","created_at":"2026-07-25T09:20:01.269Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7af4f2c1c5182aebccc71fe516d37a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.271Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ceaa2758d84f7aaf7fecde56: done: 0.055434 sec","job_status":"done","queue_duration_s":0.394627,"scheduling_latency_s":0.394659,"redis_calls":7,"redis_duration_s":0.014678,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00888,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.055434,"completed_at":"2026-07-25T09:20:01.721Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1850gitlab # [ 195.137455] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.724Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"3e6911e508596caa214edc1e","created_at":"2026-07-25T09:20:01.277Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b21673125444581edc13e9b10694b760","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-25T09:20:01.280Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-3e6911e508596caa214edc1e: start","job_status":"start","queue_duration_s":0.443737,"scheduling_latency_s":0.443846}1851gitlab # [ 195.168390] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"3e6911e508596caa214edc1e","created_at":"2026-07-25T09:20:01.277Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b21673125444581edc13e9b10694b760","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-25T09:20:01.280Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-3e6911e508596caa214edc1e: done: 0.030787 sec","job_status":"done","queue_duration_s":0.443737,"scheduling_latency_s":0.443846,"redis_calls":9,"redis_duration_s":0.002732,"redis_read_bytes":7,"redis_write_bytes":1018,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000594,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":277,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001561,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030787,"completed_at":"2026-07-25T09:20:01.754Z","load_balancing_strategy":"primary","db_duration_s":0.002924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1852gitlab # [ 195.183076] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.757Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"1d096495d5794e4687f5a34c","created_at":"2026-07-25T09:20:01.287Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f79e9477b9c2709e27a268ceb2bf3e6","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.293Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-1d096495d5794e4687f5a34c: start","job_status":"start","queue_duration_s":0.463769,"scheduling_latency_s":0.463797}1853gitlab # [ 195.223778] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.775Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"1d096495d5794e4687f5a34c","created_at":"2026-07-25T09:20:01.287Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f79e9477b9c2709e27a268ceb2bf3e6","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.293Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-1d096495d5794e4687f5a34c: done: 0.01873 sec","job_status":"done","queue_duration_s":0.463769,"scheduling_latency_s":0.463797,"redis_calls":12,"redis_duration_s":0.003306,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000548,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00052,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001729,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000509,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000366248,"duration_s":0.01873,"completed_at":"2026-07-25T09:20:01.775Z","load_balancing_strategy":"primary","db_duration_s":0.00064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1854gitlab # [ 195.269285] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.776Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"1887ae1a08b72fd14d189f68","created_at":"2026-07-25T09:20:01.303Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ffebf72c4237820198c0607d23c4923","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.310Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-1887ae1a08b72fd14d189f68: start","job_status":"start","queue_duration_s":0.466557,"scheduling_latency_s":0.46657}1855gitlab # [ 195.270219] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.797Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"1887ae1a08b72fd14d189f68","created_at":"2026-07-25T09:20:01.303Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ffebf72c4237820198c0607d23c4923","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.310Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-1887ae1a08b72fd14d189f68: done: 0.020353 sec","job_status":"done","queue_duration_s":0.466557,"scheduling_latency_s":0.46657,"redis_calls":20,"redis_duration_s":0.0040160000000000005,"redis_read_bytes":23,"redis_write_bytes":4314,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001323,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000522,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2019,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001711,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000264,"duration_s":0.020353,"completed_at":"2026-07-25T09:20:01.797Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001223,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1856gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses1857gitlab # [ 195.321657] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.798Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f0d63ae8a3a94f9ca3cfe071","created_at":"2026-07-25T09:20:01.312Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c83c6939d7c998adda4fce4c65d967c8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.314Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f0d63ae8a3a94f9ca3cfe071: start","job_status":"start","queue_duration_s":0.483898,"scheduling_latency_s":0.483911}1858gitlab # [ 195.322692] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.812Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f0d63ae8a3a94f9ca3cfe071","created_at":"2026-07-25T09:20:01.312Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c83c6939d7c998adda4fce4c65d967c8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.314Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f0d63ae8a3a94f9ca3cfe071: done: 0.01411 sec","job_status":"done","queue_duration_s":0.483898,"scheduling_latency_s":0.483911,"redis_calls":10,"redis_duration_s":0.002351,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001315,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003840432,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.01411,"completed_at":"2026-07-25T09:20:01.812Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002667,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1859gitlab # [ 195.365857] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"69750ffbbde62d49bec59b45","created_at":"2026-07-25T09:20:01.318Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"96761d36e3fbc3a4ffd6c623832be74f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.319Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-69750ffbbde62d49bec59b45: start","job_status":"start","queue_duration_s":0.493762,"scheduling_latency_s":0.493775}1860gitlab # [ 195.366682] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"69750ffbbde62d49bec59b45","created_at":"2026-07-25T09:20:01.318Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"96761d36e3fbc3a4ffd6c623832be74f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.319Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-69750ffbbde62d49bec59b45: done: 0.009729 sec","job_status":"done","queue_duration_s":0.493762,"scheduling_latency_s":0.493775,"redis_calls":7,"redis_duration_s":0.001496,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009729,"completed_at":"2026-07-25T09:20:01.823Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1861gitlab # [ 195.391757] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryCheck::DispatchWorker","jid":"efdb666f2608e6b5b59681b9","created_at":"2026-07-25T09:20:01.323Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97f8a8d1447919dbc5ff03d6b9f495fd","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:bce0277309dfde25386eb0f6b49415f8ec269d6e1b0147ad102f2a38c86bd6e2","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.328Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryCheck::DispatchWorker JID-efdb666f2608e6b5b59681b9: start","job_status":"start","queue_duration_s":0.496107,"scheduling_latency_s":0.496121}1862gitlab # [ 195.403131] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryCheck::DispatchWorker","jid":"efdb666f2608e6b5b59681b9","created_at":"2026-07-25T09:20:01.323Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97f8a8d1447919dbc5ff03d6b9f495fd","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:bce0277309dfde25386eb0f6b49415f8ec269d6e1b0147ad102f2a38c86bd6e2","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.328Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryCheck::DispatchWorker JID-efdb666f2608e6b5b59681b9: done: 0.021511 sec","job_status":"done","queue_duration_s":0.496107,"scheduling_latency_s":0.496121,"gitaly_calls":1,"gitaly_duration_s":0.002377,"redis_calls":22,"redis_duration_s":0.004105,"redis_read_bytes":41,"redis_write_bytes":2937,"redis_cache_calls":5,"redis_cache_duration_s":0.000424,"redis_cache_read_bytes":23,"redis_cache_write_bytes":95,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00091,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":658,"redis_queues_calls":2,"redis_queues_duration_s":0.000343,"redis_queues_read_bytes":3,"redis_queues_write_bytes":917,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001399,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":758,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":509,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0075423,"duration_s":0.021511,"completed_at":"2026-07-25T09:20:01.845Z","load_balancing_strategy":"primary","db_duration_s":0.000877,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1863gitlab # [ 195.459638] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.846Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"7932327d07d4a55e53514f8f","created_at":"2026-07-25T09:20:01.330Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"093f2a3360c3941a2a9afd68a54c37fd","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.339Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-7932327d07d4a55e53514f8f: start","job_status":"start","queue_duration_s":0.507188,"scheduling_latency_s":0.507203}1864gitlab # [ 195.460557] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.870Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"7932327d07d4a55e53514f8f","created_at":"2026-07-25T09:20:01.330Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"093f2a3360c3941a2a9afd68a54c37fd","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.339Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-7932327d07d4a55e53514f8f: done: 0.023621 sec","job_status":"done","queue_duration_s":0.507188,"scheduling_latency_s":0.507203,"redis_calls":10,"redis_duration_s":0.002395,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000528,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001399,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000272381,"duration_s":0.023621,"completed_at":"2026-07-25T09:20:01.870Z","load_balancing_strategy":"primary","db_duration_s":0.00797,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1865gitlab # [ 195.505180] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.871Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"96ad4e9daba49097d3e5eb6c","created_at":"2026-07-25T09:20:01.344Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6dbc9f42bdeccfc782397473ee91fe86","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.348Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-96ad4e9daba49097d3e5eb6c: start","job_status":"start","queue_duration_s":0.52357,"scheduling_latency_s":0.523583}1866gitlab # [ 195.508635] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.876Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1867gitlab # [ 195.512088] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.879Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"96ad4e9daba49097d3e5eb6c","created_at":"2026-07-25T09:20:01.344Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6dbc9f42bdeccfc782397473ee91fe86","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.348Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-96ad4e9daba49097d3e5eb6c: done: 0.008233 sec","job_status":"done","queue_duration_s":0.52357,"scheduling_latency_s":0.523583,"redis_calls":7,"redis_duration_s":0.0014370000000000001,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000404,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008233,"completed_at":"2026-07-25T09:20:01.879Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1868gitlab # [ 195.557149] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.880Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"4e82d250855db619827f6704","created_at":"2026-07-25T09:20:01.353Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f3840ae268445b647427222a3165432","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.361Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-4e82d250855db619827f6704: start","job_status":"start","queue_duration_s":0.519723,"scheduling_latency_s":0.519737}1869gitlab # [ 195.600947] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.893Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"4e82d250855db619827f6704","created_at":"2026-07-25T09:20:01.353Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f3840ae268445b647427222a3165432","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.361Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-4e82d250855db619827f6704: done: 0.012405 sec","job_status":"done","queue_duration_s":0.519723,"scheduling_latency_s":0.519737,"redis_calls":11,"redis_duration_s":0.002404,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000432,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000288,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025506,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.012405,"completed_at":"2026-07-25T09:20:01.893Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000439,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1870gitlab # [ 195.605821] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.894Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"93379e9cc93b6d8676e149e3","created_at":"2026-07-25T09:20:01.367Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61e7f207ea8fe4b49bdeec175dc44f9f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-25T09:20:01.370Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-93379e9cc93b6d8676e149e3: start","job_status":"start","queue_duration_s":0.523705,"scheduling_latency_s":0.523718}1871gitlab # [ 195.619189] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.899Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1872gitlab # [ 195.622837] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.902Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"93379e9cc93b6d8676e149e3","created_at":"2026-07-25T09:20:01.367Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61e7f207ea8fe4b49bdeec175dc44f9f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-25T09:20:01.370Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-93379e9cc93b6d8676e149e3: done: 0.008169 sec","job_status":"done","queue_duration_s":0.523705,"scheduling_latency_s":0.523718,"redis_calls":7,"redis_duration_s":0.0014949999999999998,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001089,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008169,"completed_at":"2026-07-25T09:20:01.902Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1873gitlab # [ 195.675290] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.903Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e71ceb49efe55e4c08492132","created_at":"2026-07-25T09:20:01.373Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.374Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e71ceb49efe55e4c08492132: start","job_status":"start","queue_duration_s":0.528991,"scheduling_latency_s":0.529006}1874gitlab # [ 195.676154] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.979Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e71ceb49efe55e4c08492132","created_at":"2026-07-25T09:20:01.373Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.374Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e71ceb49efe55e4c08492132: done: 0.075634 sec","job_status":"done","queue_duration_s":0.528991,"scheduling_latency_s":0.529006,"redis_calls":60,"redis_duration_s":0.020479999999999998,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.001243,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.017827,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00141,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.075634,"completed_at":"2026-07-25T09:20:01.979Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1875gitlab # [ 195.734747] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:01.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"45cf1d27095fabdf6e581263","created_at":"2026-07-25T09:20:01.384Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32233d18eb10389548e6e866b2cfc419","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.386Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-45cf1d27095fabdf6e581263: start","job_status":"start","queue_duration_s":0.596299,"scheduling_latency_s":0.596343}1876gitlab # [ 195.735668] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.016Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"45cf1d27095fabdf6e581263","created_at":"2026-07-25T09:20:01.384Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32233d18eb10389548e6e866b2cfc419","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.386Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-45cf1d27095fabdf6e581263: done: 0.034007 sec","job_status":"done","queue_duration_s":0.596299,"scheduling_latency_s":0.596343,"redis_calls":9,"redis_duration_s":0.001702,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000817,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000787251,"exclusive_lock_hold_duration_s":0.017708396,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.034007,"completed_at":"2026-07-25T09:20:02.016Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010993,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1877gitlab # [ 195.761315] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.017Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c01141d54680cf31b0a288fe","created_at":"2026-07-25T09:20:01.388Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7148df88bc87793ddb71a50cdb462f1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.390Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c01141d54680cf31b0a288fe: start","job_status":"start","queue_duration_s":0.627467,"scheduling_latency_s":0.627481}1878gitlab # [ 195.774596] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.233Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c01141d54680cf31b0a288fe","created_at":"2026-07-25T09:20:01.388Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7148df88bc87793ddb71a50cdb462f1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.390Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c01141d54680cf31b0a288fe: done: 0.215709 sec","job_status":"done","queue_duration_s":0.627467,"scheduling_latency_s":0.627481,"redis_calls":571,"redis_duration_s":0.06376899999999999,"redis_read_bytes":569,"redis_write_bytes":49487,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.063068,"redis_shared_state_read_bytes":565,"redis_shared_state_write_bytes":49017,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.177644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.215709,"completed_at":"2026-07-25T09:20:02.233Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1879gitlab # [ 195.817763] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.234Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"276f7b7672e54e4ac45196bf","created_at":"2026-07-25T09:20:01.391Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f6f47dc97c45961b34e4575681a1988","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.397Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-276f7b7672e54e4ac45196bf: start","job_status":"start","queue_duration_s":0.83663,"scheduling_latency_s":0.836653}1880gitlab # [ 195.823050] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.250Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"276f7b7672e54e4ac45196bf","created_at":"2026-07-25T09:20:01.391Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f6f47dc97c45961b34e4575681a1988","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.397Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-276f7b7672e54e4ac45196bf: done: 0.015888 sec","job_status":"done","queue_duration_s":0.83663,"scheduling_latency_s":0.836653,"redis_calls":10,"redis_duration_s":0.001226,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212039,"duration_s":0.015888,"completed_at":"2026-07-25T09:20:02.250Z","load_balancing_strategy":"primary","db_duration_s":0.002319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1881gitlab # [ 195.875325] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.250Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"f8520eb5e4f5daa05e3e7e72","created_at":"2026-07-25T09:20:01.402Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"a1bc31bc78299a272dc61614dd8a27b9","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.406Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-f8520eb5e4f5daa05e3e7e72: start","job_status":"start","queue_duration_s":0.8447,"scheduling_latency_s":0.844712}1882gitlab # [ 195.875961] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.260Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"f8520eb5e4f5daa05e3e7e72","created_at":"2026-07-25T09:20:01.402Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"a1bc31bc78299a272dc61614dd8a27b9","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.406Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-f8520eb5e4f5daa05e3e7e72: done: 0.009931 sec","job_status":"done","queue_duration_s":0.8447,"scheduling_latency_s":0.844712,"redis_calls":10,"redis_duration_s":0.001145,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000233,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000183543,"duration_s":0.009931,"completed_at":"2026-07-25T09:20:02.260Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000227,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1883gitlab # [ 195.933873] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.261Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"51f538e3f808dcea45aa9842","created_at":"2026-07-25T09:20:01.408Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76d76a2d33cbb045148ff624cc73f42c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.410Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-51f538e3f808dcea45aa9842: start","job_status":"start","queue_duration_s":0.851065,"scheduling_latency_s":0.851078}1884gitlab # [ 195.934669] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.269Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"51f538e3f808dcea45aa9842","created_at":"2026-07-25T09:20:01.408Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76d76a2d33cbb045148ff624cc73f42c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.410Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-51f538e3f808dcea45aa9842: done: 0.007578 sec","job_status":"done","queue_duration_s":0.851065,"scheduling_latency_s":0.851078,"redis_calls":7,"redis_duration_s":0.000923,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007578,"completed_at":"2026-07-25T09:20:02.269Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1885gitlab # [ 195.980841] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.270Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"cb7375c337be6ca809edfdb3","created_at":"2026-07-25T09:20:01.417Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04966085698d14a2cd05e22a3d5f031d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.424Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-cb7375c337be6ca809edfdb3: start","job_status":"start","queue_duration_s":0.84562,"scheduling_latency_s":0.845634}1886gitlab # [ 195.981656] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"cb7375c337be6ca809edfdb3","created_at":"2026-07-25T09:20:01.417Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04966085698d14a2cd05e22a3d5f031d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.424Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-cb7375c337be6ca809edfdb3: done: 0.082516 sec","job_status":"done","queue_duration_s":0.84562,"scheduling_latency_s":0.845634,"redis_calls":10,"redis_duration_s":0.001585,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000306,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001006,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208406,"duration_s":0.082516,"completed_at":"2026-07-25T09:20:02.352Z","load_balancing_strategy":"primary","db_duration_s":0.000844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1887gitlab # [ 196.028251] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.353Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"ee834a6a7b9f812dc7ed6b1b","created_at":"2026-07-25T09:20:01.431Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94867534be921470f05be4f31af1aecb","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.436Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-ee834a6a7b9f812dc7ed6b1b: start","job_status":"start","queue_duration_s":0.916806,"scheduling_latency_s":0.916821}1888gitlab # [ 196.028975] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.377Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"ee834a6a7b9f812dc7ed6b1b","created_at":"2026-07-25T09:20:01.431Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94867534be921470f05be4f31af1aecb","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.436Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-ee834a6a7b9f812dc7ed6b1b: done: 0.024055 sec","job_status":"done","queue_duration_s":0.916806,"scheduling_latency_s":0.916821,"redis_calls":10,"redis_duration_s":0.001337,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222933,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.001012419},"duration_s":0.024055,"completed_at":"2026-07-25T09:20:02.377Z","load_balancing_strategy":"primary","db_duration_s":0.006274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1889gitlab # [ 196.068657] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.378Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"814ab5f1f3ac217da07dc399","created_at":"2026-07-25T09:20:01.443Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ab7948fefd0c95df62d5908e9b080d2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.444Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-814ab5f1f3ac217da07dc399: start","job_status":"start","queue_duration_s":0.933799,"scheduling_latency_s":0.933812}1890gitlab # [ 196.074525] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.383Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1891gitlab # [ 196.077686] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"814ab5f1f3ac217da07dc399","created_at":"2026-07-25T09:20:01.443Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ab7948fefd0c95df62d5908e9b080d2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.444Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-814ab5f1f3ac217da07dc399: done: 0.007923 sec","job_status":"done","queue_duration_s":0.933799,"scheduling_latency_s":0.933812,"redis_calls":7,"redis_duration_s":0.0008600000000000001,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000607,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007923,"completed_at":"2026-07-25T09:20:02.386Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1892gitlab # [ 196.130718] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.387Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f2abe0065602a98fe1a75f81","created_at":"2026-07-25T09:20:01.450Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b03c1c7c395de60958f020f176dd6ad","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.451Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f2abe0065602a98fe1a75f81: start","job_status":"start","queue_duration_s":0.935752,"scheduling_latency_s":0.935765}1893gitlab # [ 196.131560] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.399Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f2abe0065602a98fe1a75f81","created_at":"2026-07-25T09:20:01.450Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b03c1c7c395de60958f020f176dd6ad","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.451Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f2abe0065602a98fe1a75f81: done: 0.012034 sec","job_status":"done","queue_duration_s":0.935752,"scheduling_latency_s":0.935765,"redis_calls":7,"redis_duration_s":0.00102,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.012034,"completed_at":"2026-07-25T09:20:02.399Z","load_balancing_strategy":"primary","db_duration_s":0.003486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1894gitlab # [ 196.177045] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.400Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"528e68571f0858fe1765123a","created_at":"2026-07-25T09:20:01.460Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"917af1246236a525cbaf28cbfd2d82a9","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.467Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-528e68571f0858fe1765123a: start","job_status":"start","queue_duration_s":0.932703,"scheduling_latency_s":0.932718}1895gitlab # [ 196.217605] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.418Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"528e68571f0858fe1765123a","created_at":"2026-07-25T09:20:01.460Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"917af1246236a525cbaf28cbfd2d82a9","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.467Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-528e68571f0858fe1765123a: done: 0.018728 sec","job_status":"done","queue_duration_s":0.932703,"scheduling_latency_s":0.932718,"redis_calls":10,"redis_duration_s":0.001328,"redis_read_bytes":9,"redis_write_bytes":1039,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189689,"duration_s":0.018728,"completed_at":"2026-07-25T09:20:02.418Z","load_balancing_strategy":"primary","db_duration_s":0.004668,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1896gitlab # [ 196.218711] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.419Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"b6f468e5714d46d24cc80dd5","created_at":"2026-07-25T09:20:01.475Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec227e00207310dbba1e5e543904ed1a","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.481Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-b6f468e5714d46d24cc80dd5: start","job_status":"start","queue_duration_s":0.938289,"scheduling_latency_s":0.938302}1897gitlab # [ 196.266120] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.433Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"b6f468e5714d46d24cc80dd5","created_at":"2026-07-25T09:20:01.475Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec227e00207310dbba1e5e543904ed1a","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.481Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-b6f468e5714d46d24cc80dd5: done: 0.014283 sec","job_status":"done","queue_duration_s":0.938289,"scheduling_latency_s":0.938302,"redis_calls":13,"redis_duration_s":0.001657,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000725,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000655,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000183543,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.014283,"completed_at":"2026-07-25T09:20:02.433Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001499,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1898gitlab # [ 196.270579] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.435Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8a800a941f9d167181979235","created_at":"2026-07-25T09:20:01.496Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a678c700d23b68b783abe3d1497908f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-25T09:20:01.499Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8a800a941f9d167181979235: start","job_status":"start","queue_duration_s":0.935401,"scheduling_latency_s":0.935415}1899gitlab # [ 196.283619] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.439Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1900gitlab # [ 196.286660] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.442Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8a800a941f9d167181979235","created_at":"2026-07-25T09:20:01.496Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a678c700d23b68b783abe3d1497908f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-25T09:20:01.499Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8a800a941f9d167181979235: done: 0.007653 sec","job_status":"done","queue_duration_s":0.935401,"scheduling_latency_s":0.935415,"redis_calls":7,"redis_duration_s":0.0008799999999999999,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007653,"completed_at":"2026-07-25T09:20:02.442Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1901gitlab # [ 196.351168] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.443Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"69055a77b728597253ee2561","created_at":"2026-07-25T09:20:01.503Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9513e7ae14f1a742f04d58ca86ec9b0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.505Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-69055a77b728597253ee2561: start","job_status":"start","queue_duration_s":0.938157,"scheduling_latency_s":0.93817}1902gitlab # [ 196.351890] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.456Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"69055a77b728597253ee2561","created_at":"2026-07-25T09:20:01.503Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9513e7ae14f1a742f04d58ca86ec9b0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.505Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-69055a77b728597253ee2561: done: 0.012789 sec","job_status":"done","queue_duration_s":0.938157,"scheduling_latency_s":0.93817,"redis_calls":7,"redis_duration_s":0.0009499999999999999,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012789,"completed_at":"2026-07-25T09:20:02.456Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002855,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1903gitlab # [ 196.374750] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.457Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"99cdf7b6851105b30dc8a635","created_at":"2026-07-25T09:20:01.512Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd0973e10afea767cc589eaff885f6b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.514Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-99cdf7b6851105b30dc8a635: start","job_status":"start","queue_duration_s":0.942583,"scheduling_latency_s":0.942597}1904gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses, in 1.14 seconds)1905gitlab # [ 196.417759] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.475Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"99cdf7b6851105b30dc8a635","created_at":"2026-07-25T09:20:01.512Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd0973e10afea767cc589eaff885f6b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.514Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-99cdf7b6851105b30dc8a635: done: 0.018074 sec","job_status":"done","queue_duration_s":0.942583,"scheduling_latency_s":0.942597,"redis_calls":9,"redis_duration_s":0.001273,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000617,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000391111,"exclusive_lock_hold_duration_s":0.007189461,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.018074,"completed_at":"2026-07-25T09:20:02.475Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1906gitlab # [ 196.428240] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.476Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"80fb5ba957212e8042d1bce5","created_at":"2026-07-25T09:20:01.520Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a75148abd1376ed82c1b200956ff198c","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.526Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-80fb5ba957212e8042d1bce5: start","job_status":"start","queue_duration_s":0.949935,"scheduling_latency_s":0.949949}1907gitlab # [ 196.470332] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.491Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"80fb5ba957212e8042d1bce5","created_at":"2026-07-25T09:20:01.520Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a75148abd1376ed82c1b200956ff198c","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.526Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-80fb5ba957212e8042d1bce5: done: 0.0149 sec","job_status":"done","queue_duration_s":0.949935,"scheduling_latency_s":0.949949,"redis_calls":10,"redis_duration_s":0.001258,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000244,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000187454,"duration_s":0.0149,"completed_at":"2026-07-25T09:20:02.491Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001617,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1908gitlab # [ 196.478619] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"307218d2dd8f15efcc28d308","created_at":"2026-07-25T09:20:01.544Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f5c67d3abcbf932774f00dd9a6838ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.548Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-307218d2dd8f15efcc28d308: start","job_status":"start","queue_duration_s":0.943912,"scheduling_latency_s":0.943926}1909gitlab # [ 196.492485] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.500Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"307218d2dd8f15efcc28d308","created_at":"2026-07-25T09:20:01.544Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f5c67d3abcbf932774f00dd9a6838ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.548Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-307218d2dd8f15efcc28d308: done: 0.007888 sec","job_status":"done","queue_duration_s":0.943912,"scheduling_latency_s":0.943926,"redis_calls":7,"redis_duration_s":0.0008879999999999999,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007888,"completed_at":"2026-07-25T09:20:02.500Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1910gitlab # [ 196.534833] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.501Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::CleanupPackageRegistryWorker","jid":"62403f47883e26a2f1064361","created_at":"2026-07-25T09:20:01.554Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"115a5c7ce428b7502960642af8f8dfee","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31163b2078644913f89feb2245c5fa62ac9118d29e04cf14ce0b5def57bba8ea","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.563Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::CleanupPackageRegistryWorker JID-62403f47883e26a2f1064361: start","job_status":"start","queue_duration_s":0.937798,"scheduling_latency_s":0.937812}1911gitlab # [ 196.543420] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.533Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::CleanupPackageRegistryWorker","jid":"62403f47883e26a2f1064361","created_at":"2026-07-25T09:20:01.554Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"115a5c7ce428b7502960642af8f8dfee","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31163b2078644913f89feb2245c5fa62ac9118d29e04cf14ce0b5def57bba8ea","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.563Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::CleanupPackageRegistryWorker JID-62403f47883e26a2f1064361: done: 0.032316 sec","job_status":"done","queue_duration_s":0.937798,"scheduling_latency_s":0.937812,"redis_calls":10,"redis_duration_s":0.001344,"redis_read_bytes":9,"redis_write_bytes":1125,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":10,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243606,"extra.packages_cleanup_package_registry_worker.pending_destruction_package_files_count":0,"extra.packages_cleanup_package_registry_worker.processing_package_files_count":0,"extra.packages_cleanup_package_registry_worker.error_package_files_count":0,"extra.packages_cleanup_package_registry_worker.pending_cleanup_policies_count":0,"duration_s":0.032316,"completed_at":"2026-07-25T09:20:02.533Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009086,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1912gitlab # [ 196.597817] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"994e508918a8c1711d297027","created_at":"2026-07-25T09:20:01.574Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"befa810cc2218ca046cdb7313715cdde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.578Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-994e508918a8c1711d297027: start","job_status":"start","queue_duration_s":0.95646,"scheduling_latency_s":0.956474}1913gitlab # [ 196.598580] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.539Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1914gitlab # [ 196.602028] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.542Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"994e508918a8c1711d297027","created_at":"2026-07-25T09:20:01.574Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"befa810cc2218ca046cdb7313715cdde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.578Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-994e508918a8c1711d297027: done: 0.007948 sec","job_status":"done","queue_duration_s":0.95646,"scheduling_latency_s":0.956474,"redis_calls":7,"redis_duration_s":0.000861,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000617,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007948,"completed_at":"2026-07-25T09:20:02.542Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1915gitlab # [ 196.667085] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.543Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a5a7f6168e21611e4e93b7c7","created_at":"2026-07-25T09:20:01.585Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b8aa1ce64fec3fc1167f3df0b70e0d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.588Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a5a7f6168e21611e4e93b7c7: start","job_status":"start","queue_duration_s":0.954334,"scheduling_latency_s":0.954347}1916gitlab # [ 196.667779] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.552Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a5a7f6168e21611e4e93b7c7","created_at":"2026-07-25T09:20:01.585Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b8aa1ce64fec3fc1167f3df0b70e0d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.588Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a5a7f6168e21611e4e93b7c7: done: 0.009722 sec","job_status":"done","queue_duration_s":0.954334,"scheduling_latency_s":0.954347,"redis_calls":9,"redis_duration_s":0.0012439999999999999,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000601,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000291936,"exclusive_lock_hold_duration_s":0.002073448,"duration_s":0.009722,"completed_at":"2026-07-25T09:20:02.552Z","load_balancing_strategy":"primary","db_duration_s":0.000581,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1917gitlab # [ 196.687304] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.553Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"0a10055212c596c438ddd4ba","created_at":"2026-07-25T09:20:01.602Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c101cc123e99116ab39a9044a8791848","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.611Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-0a10055212c596c438ddd4ba: start","job_status":"start","queue_duration_s":0.94185,"scheduling_latency_s":0.941863}1918gitlab # [ 196.700427] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.570Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"0a10055212c596c438ddd4ba","created_at":"2026-07-25T09:20:01.602Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c101cc123e99116ab39a9044a8791848","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.611Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-0a10055212c596c438ddd4ba: done: 0.016279 sec","job_status":"done","queue_duration_s":0.94185,"scheduling_latency_s":0.941863,"redis_calls":12,"redis_duration_s":0.001731,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000244,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000632,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00028607,"exclusive_lock_hold_duration_s":0.002574909,"duration_s":0.016279,"completed_at":"2026-07-25T09:20:02.570Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1919gitlab # [ 196.749565] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.571Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"eedafc67bded970bb19c39a4","created_at":"2026-07-25T09:20:01.618Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0828a6a7b0bbda85242b94f0cb5f42c6","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.685Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-eedafc67bded970bb19c39a4: start","job_status":"start","queue_duration_s":0.88564,"scheduling_latency_s":0.885656}1920gitlab # [ 196.750166] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.587Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"eedafc67bded970bb19c39a4","created_at":"2026-07-25T09:20:01.618Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0828a6a7b0bbda85242b94f0cb5f42c6","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.685Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-eedafc67bded970bb19c39a4: done: 0.016395 sec","job_status":"done","queue_duration_s":0.88564,"scheduling_latency_s":0.885656,"redis_calls":10,"redis_duration_s":0.001321,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000325,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201143,"duration_s":0.016395,"completed_at":"2026-07-25T09:20:02.587Z","load_balancing_strategy":"primary","db_duration_s":0.000435,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1921gitlab # [ 196.791550] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.588Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"685fc1267654a78fd9c8bad0","created_at":"2026-07-25T09:20:01.700Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3cad45efd6dc27c6a7374f700d2ad96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.706Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-685fc1267654a78fd9c8bad0: start","job_status":"start","queue_duration_s":0.88253,"scheduling_latency_s":0.882542}1922gitlab # [ 196.796544] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"685fc1267654a78fd9c8bad0","created_at":"2026-07-25T09:20:01.700Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-bd5e6fc78a3a4598","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3cad45efd6dc27c6a7374f700d2ad96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.706Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-685fc1267654a78fd9c8bad0: done: 0.015408 sec","job_status":"done","queue_duration_s":0.88253,"scheduling_latency_s":0.882542,"redis_calls":14,"redis_duration_s":0.001739,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000219,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001146,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000374,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015408,"completed_at":"2026-07-25T09:20:02.603Z","load_balancing_strategy":"primary","db_duration_s":0.000725,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1923gitlab # [ 196.844031] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.605Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"a125f50e9e776a4c86e64a2e","created_at":"2026-07-25T09:20:01.784Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-e88298b69e784902","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"9ffebf72c4237820198c0607d23c4923","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.789Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-a125f50e9e776a4c86e64a2e: start","job_status":"start","queue_duration_s":0.815742,"scheduling_latency_s":0.81617}1924gitlab # [ 196.845098] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.620Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"a125f50e9e776a4c86e64a2e","created_at":"2026-07-25T09:20:01.784Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-e88298b69e784902","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"9ffebf72c4237820198c0607d23c4923","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.789Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-a125f50e9e776a4c86e64a2e: done: 0.015312 sec","job_status":"done","queue_duration_s":0.815742,"scheduling_latency_s":0.81617,"redis_calls":10,"redis_duration_s":0.001733,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001192,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000202261,"duration_s":0.015312,"completed_at":"2026-07-25T09:20:02.620Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00061,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1925gitlab # [ 196.898530] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.621Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"386b4d2713f9bd8014b44e7e","created_at":"2026-07-25T09:20:01.789Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-e88298b69e784902","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"9ffebf72c4237820198c0607d23c4923","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.792Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-386b4d2713f9bd8014b44e7e: start","job_status":"start","queue_duration_s":0.828542,"scheduling_latency_s":0.828555}1926gitlab # [ 196.899818] gitaly[1362]: time="2026-07-25T09:20:03.021Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC964D99HANSQG59KMBTC2V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:33.020" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:03.020" grpc.time_ms=0.407 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1927gitlab # [ 196.943522] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:20:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 541928gitlab # [ 196.944244] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.632Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"386b4d2713f9bd8014b44e7e","created_at":"2026-07-25T09:20:01.789Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-e88298b69e784902","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"9ffebf72c4237820198c0607d23c4923","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.792Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-386b4d2713f9bd8014b44e7e: done: 0.011726 sec","job_status":"done","queue_duration_s":0.828542,"scheduling_latency_s":0.828555,"redis_calls":10,"redis_duration_s":0.001222,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000186895,"duration_s":0.011726,"completed_at":"2026-07-25T09:20:02.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000448,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1929gitlab # [ 196.946707] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"repository_check","args":["default"],"class":"RepositoryCheck::BatchWorker","jid":"28135d0792022efc64f1767e","created_at":"2026-07-25T09:20:01.837Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-f6ee95aa32304567","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"RepositoryCheck::DispatchWorker","correlation_id":"97f8a8d1447919dbc5ff03d6b9f495fd","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b22e99a0acd71e0cf2962b3ba955d6f34621628300baf74d4c861b087bc17605","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.840Z","job_size_bytes":11,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryCheck::BatchWorker JID-28135d0792022efc64f1767e: start","job_status":"start","queue_duration_s":0.792655,"scheduling_latency_s":0.792669}1930gitlab # [ 196.959053] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.649Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"repository_check","args":["default"],"class":"RepositoryCheck::BatchWorker","jid":"28135d0792022efc64f1767e","created_at":"2026-07-25T09:20:01.837Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-f6ee95aa32304567","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"RepositoryCheck::DispatchWorker","correlation_id":"97f8a8d1447919dbc5ff03d6b9f495fd","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b22e99a0acd71e0cf2962b3ba955d6f34621628300baf74d4c861b087bc17605","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.840Z","job_size_bytes":11,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryCheck::BatchWorker JID-28135d0792022efc64f1767e: done: 0.016364 sec","job_status":"done","queue_duration_s":0.792655,"scheduling_latency_s":0.792669,"redis_calls":13,"redis_duration_s":0.001731,"redis_read_bytes":12,"redis_write_bytes":1387,"redis_cache_calls":1,"redis_cache_duration_s":0.000148,"redis_cache_read_bytes":1,"redis_cache_write_bytes":37,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000636,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":513,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0026928,"duration_s":0.016364,"completed_at":"2026-07-25T09:20:02.649Z","load_balancing_strategy":"primary","db_duration_s":0.001363,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1931gitlab # [ 197.003586] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93855a6cee6df9268497dda5","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93855a6cee6df9268497dda5: start","job_status":"start","queue_duration_s":0.684304,"scheduling_latency_s":0.684317}1932gitlab # [ 197.007409] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93855a6cee6df9268497dda5","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93855a6cee6df9268497dda5: done: 0.009872 sec","job_status":"done","queue_duration_s":0.684304,"scheduling_latency_s":0.684317,"redis_calls":13,"redis_duration_s":0.0017289999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009872,"completed_at":"2026-07-25T09:20:02.660Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1933gitlab # [ 197.052469] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbd5a612abcae5d26ce18dc6","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbd5a612abcae5d26ce18dc6: start","job_status":"start","queue_duration_s":0.694986,"scheduling_latency_s":0.694999}1934gitlab # [ 197.053069] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbd5a612abcae5d26ce18dc6","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbd5a612abcae5d26ce18dc6: done: 0.009417 sec","job_status":"done","queue_duration_s":0.694986,"scheduling_latency_s":0.694999,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009417,"completed_at":"2026-07-25T09:20:02.670Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1935gitlab # [ 197.101075] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6ea0ea7abd04557d0018557","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6ea0ea7abd04557d0018557: start","job_status":"start","queue_duration_s":0.705219,"scheduling_latency_s":0.705232}1936gitlab # [ 197.101740] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6ea0ea7abd04557d0018557","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6ea0ea7abd04557d0018557: done: 0.009151 sec","job_status":"done","queue_duration_s":0.705219,"scheduling_latency_s":0.705232,"redis_calls":13,"redis_duration_s":0.001516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009151,"completed_at":"2026-07-25T09:20:02.680Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1937gitlab # [ 197.142574] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"162ef0c09cc5aea836b29713","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-162ef0c09cc5aea836b29713: start","job_status":"start","queue_duration_s":0.71515,"scheduling_latency_s":0.715164}1938gitlab # [ 197.143167] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"162ef0c09cc5aea836b29713","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-162ef0c09cc5aea836b29713: done: 0.009233 sec","job_status":"done","queue_duration_s":0.71515,"scheduling_latency_s":0.715164,"redis_calls":13,"redis_duration_s":0.0014299999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009233,"completed_at":"2026-07-25T09:20:02.690Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1939gitlab # [ 197.202817] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edfd82598aeb4e714eec7eda","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edfd82598aeb4e714eec7eda: start","job_status":"start","queue_duration_s":0.725183,"scheduling_latency_s":0.725197}1940gitlab # [ 197.203631] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edfd82598aeb4e714eec7eda","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edfd82598aeb4e714eec7eda: done: 0.009179 sec","job_status":"done","queue_duration_s":0.725183,"scheduling_latency_s":0.725197,"redis_calls":13,"redis_duration_s":0.0016359999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001132,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009179,"completed_at":"2026-07-25T09:20:02.700Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1941gitlab # [ 197.244257] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"226d5e6c70baba3ccb0987ca","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-226d5e6c70baba3ccb0987ca: start","job_status":"start","queue_duration_s":0.735182,"scheduling_latency_s":0.735195}1942gitlab # [ 197.244820] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"226d5e6c70baba3ccb0987ca","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-226d5e6c70baba3ccb0987ca: done: 0.009187 sec","job_status":"done","queue_duration_s":0.735182,"scheduling_latency_s":0.735195,"redis_calls":13,"redis_duration_s":0.001719,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009187,"completed_at":"2026-07-25T09:20:02.710Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1943gitlab # [ 197.288888] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53d778310f25d6ed0a589fef","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53d778310f25d6ed0a589fef: start","job_status":"start","queue_duration_s":0.745638,"scheduling_latency_s":0.745651}1944gitlab # [ 197.289574] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53d778310f25d6ed0a589fef","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53d778310f25d6ed0a589fef: done: 0.009065 sec","job_status":"done","queue_duration_s":0.745638,"scheduling_latency_s":0.745651,"redis_calls":13,"redis_duration_s":0.0015019999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000473,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009065,"completed_at":"2026-07-25T09:20:02.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1945gitlab # [ 197.340691] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33cb31ba82f83d661b8962b7","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33cb31ba82f83d661b8962b7: start","job_status":"start","queue_duration_s":0.755507,"scheduling_latency_s":0.75552}1946gitlab # [ 197.341406] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33cb31ba82f83d661b8962b7","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33cb31ba82f83d661b8962b7: done: 0.009004 sec","job_status":"done","queue_duration_s":0.755507,"scheduling_latency_s":0.75552,"redis_calls":13,"redis_duration_s":0.00142,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009004,"completed_at":"2026-07-25T09:20:02.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1947gitlab # [ 197.380886] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13fabe45ba73ae68439f023a","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13fabe45ba73ae68439f023a: start","job_status":"start","queue_duration_s":0.765745,"scheduling_latency_s":0.765759}1948gitlab # [ 197.381720] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13fabe45ba73ae68439f023a","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13fabe45ba73ae68439f023a: done: 0.008941 sec","job_status":"done","queue_duration_s":0.765745,"scheduling_latency_s":0.765759,"redis_calls":13,"redis_duration_s":0.001432,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000457,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008941,"completed_at":"2026-07-25T09:20:02.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1949gitlab # [ 197.439236] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7e34cce6780bef5a37ae7c4","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7e34cce6780bef5a37ae7c4: start","job_status":"start","queue_duration_s":0.775437,"scheduling_latency_s":0.775475}1950gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses1951gitlab # [ 197.439945] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7e34cce6780bef5a37ae7c4","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7e34cce6780bef5a37ae7c4: done: 0.008939 sec","job_status":"done","queue_duration_s":0.775437,"scheduling_latency_s":0.775475,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008939,"completed_at":"2026-07-25T09:20:02.750Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1952gitlab # [ 197.480506] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89c85df4166145d6bb799e27","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89c85df4166145d6bb799e27: start","job_status":"start","queue_duration_s":0.785145,"scheduling_latency_s":0.785158}1953gitlab # [ 197.481202] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89c85df4166145d6bb799e27","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89c85df4166145d6bb799e27: done: 0.008869 sec","job_status":"done","queue_duration_s":0.785145,"scheduling_latency_s":0.785158,"redis_calls":13,"redis_duration_s":0.0014620000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008869,"completed_at":"2026-07-25T09:20:02.760Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1954gitlab # [ 197.495133] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84661dbd028416994ce1ac30","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84661dbd028416994ce1ac30: start","job_status":"start","queue_duration_s":0.795194,"scheduling_latency_s":0.795207}1955gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses, in 0.09 seconds)1956gitlab # [ 197.505878] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84661dbd028416994ce1ac30","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84661dbd028416994ce1ac30: done: 0.008993 sec","job_status":"done","queue_duration_s":0.795194,"scheduling_latency_s":0.795207,"redis_calls":13,"redis_duration_s":0.0014830000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000453,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008993,"completed_at":"2026-07-25T09:20:02.770Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1957gitlab # [ 197.546166] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd4417a7287b5e804a7c9450","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd4417a7287b5e804a7c9450: start","job_status":"start","queue_duration_s":0.805124,"scheduling_latency_s":0.805138}1958gitlab # [ 197.551635] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd4417a7287b5e804a7c9450","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd4417a7287b5e804a7c9450: done: 0.008814 sec","job_status":"done","queue_duration_s":0.805124,"scheduling_latency_s":0.805138,"redis_calls":13,"redis_duration_s":0.001677,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008814,"completed_at":"2026-07-25T09:20:02.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1959gitlab # [ 197.599043] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24b9675fd7265d1ab306ffae","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24b9675fd7265d1ab306ffae: start","job_status":"start","queue_duration_s":0.814835,"scheduling_latency_s":0.814848}1960gitlab # [ 197.599741] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24b9675fd7265d1ab306ffae","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24b9675fd7265d1ab306ffae: done: 0.008905 sec","job_status":"done","queue_duration_s":0.814835,"scheduling_latency_s":0.814848,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008905,"completed_at":"2026-07-25T09:20:02.790Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1961gitlab # [ 197.642713] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ba321937675e5b30fd53192","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ba321937675e5b30fd53192: start","job_status":"start","queue_duration_s":0.824542,"scheduling_latency_s":0.824555}1962gitlab # [ 197.643552] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ba321937675e5b30fd53192","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ba321937675e5b30fd53192: done: 0.008738 sec","job_status":"done","queue_duration_s":0.824542,"scheduling_latency_s":0.824555,"redis_calls":13,"redis_duration_s":0.001488,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008738,"completed_at":"2026-07-25T09:20:02.799Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1963gitlab # [ 197.677075] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4079d3bf468f63dd54afdf54","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4079d3bf468f63dd54afdf54: start","job_status":"start","queue_duration_s":0.834077,"scheduling_latency_s":0.83409}1964gitlab # [ 197.722890] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4079d3bf468f63dd54afdf54","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4079d3bf468f63dd54afdf54: done: 0.009077 sec","job_status":"done","queue_duration_s":0.834077,"scheduling_latency_s":0.83409,"redis_calls":13,"redis_duration_s":0.001573,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009077,"completed_at":"2026-07-25T09:20:02.809Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1965gitlab # [ 197.723908] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce5b2b2bb9e6094d4041cc77","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce5b2b2bb9e6094d4041cc77: start","job_status":"start","queue_duration_s":0.844174,"scheduling_latency_s":0.844187}1966gitlab # [ 197.733115] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce5b2b2bb9e6094d4041cc77","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce5b2b2bb9e6094d4041cc77: done: 0.008746 sec","job_status":"done","queue_duration_s":0.844174,"scheduling_latency_s":0.844187,"redis_calls":13,"redis_duration_s":0.001413,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008746,"completed_at":"2026-07-25T09:20:02.819Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1967gitlab # [ 197.773638] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41dd12ecabe31993b8785b49","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41dd12ecabe31993b8785b49: start","job_status":"start","queue_duration_s":0.853838,"scheduling_latency_s":0.853851}1968gitlab # [ 197.778050] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41dd12ecabe31993b8785b49","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41dd12ecabe31993b8785b49: done: 0.008687 sec","job_status":"done","queue_duration_s":0.853838,"scheduling_latency_s":0.853851,"redis_calls":13,"redis_duration_s":0.001565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008687,"completed_at":"2026-07-25T09:20:02.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1969gitlab # [ 197.813443] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab3d90ffb10169efa4966f1c","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab3d90ffb10169efa4966f1c: start","job_status":"start","queue_duration_s":0.8633,"scheduling_latency_s":0.863313}1970gitlab # [ 197.852277] gitaly[1362]: time="2026-07-25T09:20:04.133Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC965G76M5WNFNG1C30NAMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:34.132" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:04.132" grpc.time_ms=0.431 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1971gitlab # [ 197.852880] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:20:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 451972gitlab # [ 197.853522] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab3d90ffb10169efa4966f1c","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab3d90ffb10169efa4966f1c: done: 0.00882 sec","job_status":"done","queue_duration_s":0.8633,"scheduling_latency_s":0.863313,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00882,"completed_at":"2026-07-25T09:20:02.838Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1973gitlab # [ 197.903079] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c5b387955a7c756ecb86245","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c5b387955a7c756ecb86245: start","job_status":"start","queue_duration_s":0.872925,"scheduling_latency_s":0.872938}1974gitlab # [ 197.903764] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c5b387955a7c756ecb86245","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c5b387955a7c756ecb86245: done: 0.008684 sec","job_status":"done","queue_duration_s":0.872925,"scheduling_latency_s":0.872938,"redis_calls":13,"redis_duration_s":0.0014919999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008684,"completed_at":"2026-07-25T09:20:02.848Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1975gitlab # [ 197.916951] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a027c15d5a6099fe0922b1e9","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a027c15d5a6099fe0922b1e9: start","job_status":"start","queue_duration_s":0.882522,"scheduling_latency_s":0.882536}1976gitlab # [ 197.928203] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a027c15d5a6099fe0922b1e9","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a027c15d5a6099fe0922b1e9: done: 0.008696 sec","job_status":"done","queue_duration_s":0.882522,"scheduling_latency_s":0.882536,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000471,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008696,"completed_at":"2026-07-25T09:20:02.857Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1977gitlab # [ 197.971044] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc51664740c46f0e12fbe520","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc51664740c46f0e12fbe520: start","job_status":"start","queue_duration_s":0.892087,"scheduling_latency_s":0.8921}1978gitlab # [ 198.009153] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc51664740c46f0e12fbe520","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc51664740c46f0e12fbe520: done: 0.008981 sec","job_status":"done","queue_duration_s":0.892087,"scheduling_latency_s":0.8921,"redis_calls":13,"redis_duration_s":0.0014489999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008981,"completed_at":"2026-07-25T09:20:02.867Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1979gitlab # [ 198.010060] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7ab1d7332c79473b9b90965","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7ab1d7332c79473b9b90965: start","job_status":"start","queue_duration_s":0.901882,"scheduling_latency_s":0.901894}1980gitlab # [ 198.018650] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7ab1d7332c79473b9b90965","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7ab1d7332c79473b9b90965: done: 0.008828 sec","job_status":"done","queue_duration_s":0.901882,"scheduling_latency_s":0.901894,"redis_calls":13,"redis_duration_s":0.00151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008828,"completed_at":"2026-07-25T09:20:02.877Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1981gitlab # [ 198.087115] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b4b5173b68fe8fabb00a1b6","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b4b5173b68fe8fabb00a1b6: start","job_status":"start","queue_duration_s":0.911498,"scheduling_latency_s":0.911512}1982gitlab # [ 198.087754] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b4b5173b68fe8fabb00a1b6","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b4b5173b68fe8fabb00a1b6: done: 0.009157 sec","job_status":"done","queue_duration_s":0.911498,"scheduling_latency_s":0.911512,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009157,"completed_at":"2026-07-25T09:20:02.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1983gitlab # [ 198.098649] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d2725dcddaf03be2760624f","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d2725dcddaf03be2760624f: start","job_status":"start","queue_duration_s":0.921411,"scheduling_latency_s":0.921425}1984gitlab # [ 198.143707] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d2725dcddaf03be2760624f","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d2725dcddaf03be2760624f: done: 0.008771 sec","job_status":"done","queue_duration_s":0.921411,"scheduling_latency_s":0.921425,"redis_calls":13,"redis_duration_s":0.0014680000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008771,"completed_at":"2026-07-25T09:20:02.896Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1985gitlab # [ 198.144713] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8788f1ff3d8185d7f38f6674","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8788f1ff3d8185d7f38f6674: start","job_status":"start","queue_duration_s":0.930974,"scheduling_latency_s":0.930988}1986gitlab # [ 198.155490] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8788f1ff3d8185d7f38f6674","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8788f1ff3d8185d7f38f6674: done: 0.008842 sec","job_status":"done","queue_duration_s":0.930974,"scheduling_latency_s":0.930988,"redis_calls":13,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008842,"completed_at":"2026-07-25T09:20:02.906Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1987gitlab # [ 198.194269] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f907ac941c6dbd5f6eae5478","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f907ac941c6dbd5f6eae5478: start","job_status":"start","queue_duration_s":0.940612,"scheduling_latency_s":0.940625}1988gitlab # [ 198.232073] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f907ac941c6dbd5f6eae5478","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f907ac941c6dbd5f6eae5478: done: 0.008903 sec","job_status":"done","queue_duration_s":0.940612,"scheduling_latency_s":0.940625,"redis_calls":13,"redis_duration_s":0.001647,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008903,"completed_at":"2026-07-25T09:20:02.916Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1989gitlab # [ 198.234886] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"694e0be85e650dc721a6f2a5","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-694e0be85e650dc721a6f2a5: start","job_status":"start","queue_duration_s":0.950389,"scheduling_latency_s":0.950402}1990gitlab # [ 198.283197] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"694e0be85e650dc721a6f2a5","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-694e0be85e650dc721a6f2a5: done: 0.008718 sec","job_status":"done","queue_duration_s":0.950389,"scheduling_latency_s":0.950402,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008718,"completed_at":"2026-07-25T09:20:02.925Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1991gitlab # [ 198.284222] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b25d0453faa97f82e430b0bd","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b25d0453faa97f82e430b0bd: start","job_status":"start","queue_duration_s":0.959905,"scheduling_latency_s":0.959918}1992gitlab # [ 198.291207] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b25d0453faa97f82e430b0bd","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b25d0453faa97f82e430b0bd: done: 0.008684 sec","job_status":"done","queue_duration_s":0.959905,"scheduling_latency_s":0.959918,"redis_calls":13,"redis_duration_s":0.001486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008684,"completed_at":"2026-07-25T09:20:02.935Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1993gitlab # [ 198.326482] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc392116cfe6760c9591808f","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc392116cfe6760c9591808f: start","job_status":"start","queue_duration_s":0.96974,"scheduling_latency_s":0.969754}1994gitlab # [ 198.366945] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc392116cfe6760c9591808f","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc392116cfe6760c9591808f: done: 0.008864 sec","job_status":"done","queue_duration_s":0.96974,"scheduling_latency_s":0.969754,"redis_calls":13,"redis_duration_s":0.00151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008864,"completed_at":"2026-07-25T09:20:02.945Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1995gitlab # [ 198.371210] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27a41f1a57b38b8334956392","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27a41f1a57b38b8334956392: start","job_status":"start","queue_duration_s":0.97937,"scheduling_latency_s":0.979383}1996gitlab # [ 198.382424] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27a41f1a57b38b8334956392","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27a41f1a57b38b8334956392: done: 0.00882 sec","job_status":"done","queue_duration_s":0.97937,"scheduling_latency_s":0.979383,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00882,"completed_at":"2026-07-25T09:20:02.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1997gitlab # [ 198.423996] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f620c2b6b66a7e3243fcb60e","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f620c2b6b66a7e3243fcb60e: start","job_status":"start","queue_duration_s":0.988977,"scheduling_latency_s":0.988991}1998gitlab # [ 198.464127] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f620c2b6b66a7e3243fcb60e","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f620c2b6b66a7e3243fcb60e: done: 0.008816 sec","job_status":"done","queue_duration_s":0.988977,"scheduling_latency_s":0.988991,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008816,"completed_at":"2026-07-25T09:20:02.964Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1999gitlab # [ 198.465075] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ea387f2fd6ba69ebcf11efc","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ea387f2fd6ba69ebcf11efc: start","job_status":"start","queue_duration_s":0.998759,"scheduling_latency_s":0.998773}2000gitlab # [ 198.473845] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ea387f2fd6ba69ebcf11efc","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ea387f2fd6ba69ebcf11efc: done: 0.008841 sec","job_status":"done","queue_duration_s":0.998759,"scheduling_latency_s":0.998773,"redis_calls":13,"redis_duration_s":0.001655,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00068,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008841,"completed_at":"2026-07-25T09:20:02.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2001gitlab # [ 198.512778] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3dc9d3f35707d2dc2e577d5","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3dc9d3f35707d2dc2e577d5: start","job_status":"start","queue_duration_s":1.008373,"scheduling_latency_s":1.008387}2002gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses2003gitlab # [ 198.519045] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3dc9d3f35707d2dc2e577d5","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3dc9d3f35707d2dc2e577d5: done: 0.008933 sec","job_status":"done","queue_duration_s":1.008373,"scheduling_latency_s":1.008387,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008933,"completed_at":"2026-07-25T09:20:02.983Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2004gitlab # [ 198.557460] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7f8e5acc6450fd1823b91e5","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7f8e5acc6450fd1823b91e5: start","job_status":"start","queue_duration_s":1.018849,"scheduling_latency_s":1.018881}2005gitlab # [ 198.597202] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7f8e5acc6450fd1823b91e5","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7f8e5acc6450fd1823b91e5: done: 0.010716 sec","job_status":"done","queue_duration_s":1.018849,"scheduling_latency_s":1.018881,"redis_calls":13,"redis_duration_s":0.0015179999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010716,"completed_at":"2026-07-25T09:20:02.995Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2006gitlab # [ 198.598399] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:02.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97ad25fd3efa75fbb7814d23","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97ad25fd3efa75fbb7814d23: start","job_status":"start","queue_duration_s":1.030511,"scheduling_latency_s":1.030524}2007gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses, in 0.10 seconds)2008gitlab # [ 198.639065] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97ad25fd3efa75fbb7814d23","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97ad25fd3efa75fbb7814d23: done: 0.013174 sec","job_status":"done","queue_duration_s":1.030511,"scheduling_latency_s":1.030524,"redis_calls":13,"redis_duration_s":0.004583,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002735,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013174,"completed_at":"2026-07-25T09:20:03.010Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2009gitlab # [ 198.642250] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b274fddf3a111f5a9b14c06a","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b274fddf3a111f5a9b14c06a: start","job_status":"start","queue_duration_s":1.045061,"scheduling_latency_s":1.045078}2010gitlab # [ 198.683769] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b274fddf3a111f5a9b14c06a","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b274fddf3a111f5a9b14c06a: done: 0.011861 sec","job_status":"done","queue_duration_s":1.045061,"scheduling_latency_s":1.045078,"redis_calls":13,"redis_duration_s":0.0021390000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001518,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011861,"completed_at":"2026-07-25T09:20:03.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2011gitlab # [ 198.688652] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac01477db206882743ec015c","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac01477db206882743ec015c: start","job_status":"start","queue_duration_s":1.057778,"scheduling_latency_s":1.057792}2012gitlab # [ 198.699776] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac01477db206882743ec015c","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac01477db206882743ec015c: done: 0.012277 sec","job_status":"done","queue_duration_s":1.057778,"scheduling_latency_s":1.057792,"redis_calls":13,"redis_duration_s":0.001987,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001416,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012277,"completed_at":"2026-07-25T09:20:03.036Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2013gitlab # [ 198.753194] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca77ed3d93eb2919665ffde0","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca77ed3d93eb2919665ffde0: start","job_status":"start","queue_duration_s":1.071433,"scheduling_latency_s":1.071479}2014gitlab # [ 198.754374] gitaly[1362]: time="2026-07-25T09:20:05.236Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC966J9R3GSBHBCBXCYVA92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:35.235" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:05.236" grpc.time_ms=0.491 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2015gitlab # [ 198.757695] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:20:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 582016gitlab # [ 198.759964] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca77ed3d93eb2919665ffde0","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca77ed3d93eb2919665ffde0: done: 0.010773 sec","job_status":"done","queue_duration_s":1.071433,"scheduling_latency_s":1.071479,"redis_calls":13,"redis_duration_s":0.0019649999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001413,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010773,"completed_at":"2026-07-25T09:20:03.048Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2017gitlab # [ 198.816593] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02ae290ccd737ce8669e20ea","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02ae290ccd737ce8669e20ea: start","job_status":"start","queue_duration_s":1.083001,"scheduling_latency_s":1.083014}2018gitlab # [ 198.817442] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02ae290ccd737ce8669e20ea","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02ae290ccd737ce8669e20ea: done: 0.012441 sec","job_status":"done","queue_duration_s":1.083001,"scheduling_latency_s":1.083014,"redis_calls":13,"redis_duration_s":0.004738999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004238,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012441,"completed_at":"2026-07-25T09:20:03.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2019gitlab # [ 198.866271] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29b4c2fd65a4099fa812d978","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29b4c2fd65a4099fa812d978: start","job_status":"start","queue_duration_s":1.096564,"scheduling_latency_s":1.096577}2020gitlab # [ 198.867040] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29b4c2fd65a4099fa812d978","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29b4c2fd65a4099fa812d978: done: 0.008954 sec","job_status":"done","queue_duration_s":1.096564,"scheduling_latency_s":1.096577,"redis_calls":13,"redis_duration_s":0.001547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008954,"completed_at":"2026-07-25T09:20:03.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2021gitlab # [ 198.885585] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07e6367d1872a99523010145","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07e6367d1872a99523010145: start","job_status":"start","queue_duration_s":1.106296,"scheduling_latency_s":1.106309}2022gitlab # [ 198.925613] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07e6367d1872a99523010145","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07e6367d1872a99523010145: done: 0.009237 sec","job_status":"done","queue_duration_s":1.106296,"scheduling_latency_s":1.106309,"redis_calls":13,"redis_duration_s":0.001516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009237,"completed_at":"2026-07-25T09:20:03.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2023gitlab # [ 198.930848] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62841a16b5235243d4fca907","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62841a16b5235243d4fca907: start","job_status":"start","queue_duration_s":1.116325,"scheduling_latency_s":1.116339}2024gitlab # [ 198.942063] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62841a16b5235243d4fca907","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62841a16b5235243d4fca907: done: 0.008904 sec","job_status":"done","queue_duration_s":1.116325,"scheduling_latency_s":1.116339,"redis_calls":13,"redis_duration_s":0.00158,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008904,"completed_at":"2026-07-25T09:20:03.091Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025gitlab # [ 199.002658] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9379f7de3d880007976fc72c","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9379f7de3d880007976fc72c: start","job_status":"start","queue_duration_s":1.126028,"scheduling_latency_s":1.126042}2026gitlab # [ 199.003506] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9379f7de3d880007976fc72c","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9379f7de3d880007976fc72c: done: 0.009151 sec","job_status":"done","queue_duration_s":1.126028,"scheduling_latency_s":1.126042,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009151,"completed_at":"2026-07-25T09:20:03.101Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2027gitlab # [ 199.023142] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8fb8015bea030a8078af632","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8fb8015bea030a8078af632: start","job_status":"start","queue_duration_s":1.135981,"scheduling_latency_s":1.135994}2028gitlab # [ 199.034194] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8fb8015bea030a8078af632","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8fb8015bea030a8078af632: done: 0.008831 sec","job_status":"done","queue_duration_s":1.135981,"scheduling_latency_s":1.135994,"redis_calls":13,"redis_duration_s":0.001533,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008831,"completed_at":"2026-07-25T09:20:03.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2029gitlab # [ 199.087644] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93626b9df1505c57bd9c8d79","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93626b9df1505c57bd9c8d79: start","job_status":"start","queue_duration_s":1.145849,"scheduling_latency_s":1.145862}2030gitlab # [ 199.088393] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93626b9df1505c57bd9c8d79","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93626b9df1505c57bd9c8d79: done: 0.008925 sec","job_status":"done","queue_duration_s":1.145849,"scheduling_latency_s":1.145862,"redis_calls":13,"redis_duration_s":0.0015240000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008925,"completed_at":"2026-07-25T09:20:03.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2031gitlab # [ 199.114720] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21f176f57c1293f504eac348","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21f176f57c1293f504eac348: start","job_status":"start","queue_duration_s":1.155595,"scheduling_latency_s":1.155608}2032gitlab # [ 199.126497] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21f176f57c1293f504eac348","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21f176f57c1293f504eac348: done: 0.011941 sec","job_status":"done","queue_duration_s":1.155595,"scheduling_latency_s":1.155608,"redis_calls":13,"redis_duration_s":0.001898,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001367,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011941,"completed_at":"2026-07-25T09:20:03.134Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2033gitlab # [ 199.169243] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"102848dae53e50611e604cde","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-102848dae53e50611e604cde: start","job_status":"start","queue_duration_s":1.168653,"scheduling_latency_s":1.168674}2034gitlab # [ 199.171887] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"102848dae53e50611e604cde","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-102848dae53e50611e604cde: done: 0.010339 sec","job_status":"done","queue_duration_s":1.168653,"scheduling_latency_s":1.168674,"redis_calls":13,"redis_duration_s":0.001563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010339,"completed_at":"2026-07-25T09:20:03.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2035gitlab # [ 199.213278] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab58ad09759abd0a662ee535","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab58ad09759abd0a662ee535: start","job_status":"start","queue_duration_s":1.17978,"scheduling_latency_s":1.179792}2036gitlab # [ 199.217891] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab58ad09759abd0a662ee535","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab58ad09759abd0a662ee535: done: 0.008812 sec","job_status":"done","queue_duration_s":1.17978,"scheduling_latency_s":1.179792,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008812,"completed_at":"2026-07-25T09:20:03.155Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2037gitlab # [ 199.289684] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60ff6e1fecbbbe2f619207f8","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60ff6e1fecbbbe2f619207f8: start","job_status":"start","queue_duration_s":1.189956,"scheduling_latency_s":1.189969}2038gitlab # [ 199.290400] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60ff6e1fecbbbe2f619207f8","created_at":"2026-07-25T09:20:01.909Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-b99a6fad423048dd","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7721794e24b350d5afac1b7f3bb2644b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:01.966Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60ff6e1fecbbbe2f619207f8: done: 0.009785 sec","job_status":"done","queue_duration_s":1.189956,"scheduling_latency_s":1.189969,"redis_calls":13,"redis_duration_s":0.001568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009785,"completed_at":"2026-07-25T09:20:03.166Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2039gitlab # [ 199.331732] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.167Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7e4ab8fed9f2f10efb28259a","created_at":"2026-07-25T09:20:02.595Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-ce601f4037f74a14","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3cad45efd6dc27c6a7374f700d2ad96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:02.600Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7e4ab8fed9f2f10efb28259a: start","job_status":"start","queue_duration_s":0.566477,"scheduling_latency_s":0.566491}2040gitlab # [ 199.332526] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.174Z","message":"No existing merge request to be cleaned up."}2041gitlab # [ 199.332990] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.179Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7e4ab8fed9f2f10efb28259a","created_at":"2026-07-25T09:20:02.595Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-ce601f4037f74a14","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3cad45efd6dc27c6a7374f700d2ad96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:02.600Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7e4ab8fed9f2f10efb28259a: done: 0.012005 sec","job_status":"done","queue_duration_s":0.566477,"scheduling_latency_s":0.566491,"redis_calls":10,"redis_duration_s":0.001339,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000787,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012005,"completed_at":"2026-07-25T09:20:03.179Z","load_balancing_strategy":"primary","db_duration_s":0.001402,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2042gitlab # [ 199.347541] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.180Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3fc24291ffcc854f0984e5bc","created_at":"2026-07-25T09:20:02.595Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-ce601f4037f74a14","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3cad45efd6dc27c6a7374f700d2ad96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:02.600Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3fc24291ffcc854f0984e5bc: start","job_status":"start","queue_duration_s":0.579554,"scheduling_latency_s":0.579568}2043gitlab # [ 199.358704] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.186Z","message":"No existing merge request to be cleaned up."}2044gitlab # [ 199.360138] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.191Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3fc24291ffcc854f0984e5bc","created_at":"2026-07-25T09:20:02.595Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-ce601f4037f74a14","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3cad45efd6dc27c6a7374f700d2ad96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:02.600Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3fc24291ffcc854f0984e5bc: done: 0.010609 sec","job_status":"done","queue_duration_s":0.579554,"scheduling_latency_s":0.579568,"redis_calls":10,"redis_duration_s":0.001362,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000848,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010609,"completed_at":"2026-07-25T09:20:03.190Z","load_balancing_strategy":"primary","db_duration_s":0.00098,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2045gitlab # [ 199.415748] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.192Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"42aa6648c401b1f700b56ef3","created_at":"2026-07-25T09:20:02.595Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-ce601f4037f74a14","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3cad45efd6dc27c6a7374f700d2ad96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:02.600Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-42aa6648c401b1f700b56ef3: start","job_status":"start","queue_duration_s":0.591285,"scheduling_latency_s":0.591299}2046gitlab # [ 199.416543] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.198Z","message":"No existing merge request to be cleaned up."}2047gitlab # [ 199.417073] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.202Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"42aa6648c401b1f700b56ef3","created_at":"2026-07-25T09:20:02.595Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-ce601f4037f74a14","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3cad45efd6dc27c6a7374f700d2ad96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:02.600Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-42aa6648c401b1f700b56ef3: done: 0.010627 sec","job_status":"done","queue_duration_s":0.591285,"scheduling_latency_s":0.591299,"redis_calls":10,"redis_duration_s":0.001297,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000798,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010627,"completed_at":"2026-07-25T09:20:03.202Z","load_balancing_strategy":"primary","db_duration_s":0.000952,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2048gitlab # [ 199.479981] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.203Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c9df5d058564beb25d789e71","created_at":"2026-07-25T09:20:02.595Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-ce601f4037f74a14","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3cad45efd6dc27c6a7374f700d2ad96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:02.600Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c9df5d058564beb25d789e71: start","job_status":"start","queue_duration_s":0.602926,"scheduling_latency_s":0.602939}2049gitlab # [ 199.480592] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.209Z","message":"No existing merge request to be cleaned up."}2050gitlab # [ 199.481101] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:03.214Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c9df5d058564beb25d789e71","created_at":"2026-07-25T09:20:02.595Z","trace_propagation_headers":{"sentry-trace":"7a7b8ca0ed594e57a2bfd60545013b22-ce601f4037f74a14","baggage":"sentry-trace_id=7a7b8ca0ed594e57a2bfd60545013b22,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d3cad45efd6dc27c6a7374f700d2ad96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:20:02.600Z","job_size_bytes":2,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c9df5d058564beb25d789e71: done: 0.010766 sec","job_status":"done","queue_duration_s":0.602926,"scheduling_latency_s":0.602939,"redis_calls":10,"redis_duration_s":0.0017109999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010766,"completed_at":"2026-07-25T09:20:03.214Z","load_balancing_strategy":"primary","db_duration_s":0.000885,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2051gitlab # [ 199.671420] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 4485893513 wd_nsec: 44858934642052gitlab # [ 199.588579] nix-daemon[3316]: accepted connection from pid 3432, user nixbot2053gitlab # [ 199.644340] gitaly[1362]: time="2026-07-25T09:20:06.231Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC967HKVYCVN0H0A5Z9KHJ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:36.230" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:06.230" grpc.time_ms=0.56 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses2055gitlab # [ 199.697916] gitaly[1362]: time="2026-07-25T09:20:06.284Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=1 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC967HKVYCVN0H0A5Z9KHJ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:20:16.247" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:20:06.277" grpc.time_ms=7.046 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2056gitlab # [ 199.743696] sidekiq-cluster[2071]: {"severity":"INFO","time":"2026-07-25T09:20:06.329Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5fef5c9135888a515cad58a0","created_at":"2026-07-25T09:20:06.325Z","trace_propagation_headers":{"sentry-trace":"6e8f731b4bb4453389d457406e1c2413-6f377527e2b34eb2","baggage":"sentry-trace_id=6e8f731b4bb4453389d457406e1c2413,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC967HKVYCVN0H0A5Z9KHJ1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:20:06.328Z","job_size_bytes":3,"pid":2071,"sidekiq_tid":"m2wr","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5fef5c9135888a515cad58a0: start","job_status":"start","queue_duration_s":0.001356,"scheduling_latency_s":0.001383}2057gitlab # [ 199.753223] gitaly[1362]: time="2026-07-25T09:20:06.340Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC967N1B3FECKGN9NFQTK4D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:20:36.338" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:20:06.339" grpc.time_ms=0.459 pid=1362 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2058gitlab # [ 199.782122] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:20:06 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses HTTP/1.1" 200 1328 "" "curl/8.20.0" 622059gitlab # [ 199.783514] gitlab-workhorse[1285]: gitlab 2001:db8:1::1 - - [2026/07/25:09:20:06 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f86ec66befc33c10476f5f3558ea79591a92b335 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1732060gitlab # [ 199.784665] nixbot[3022]: {"ts": "2026-07-25T09:20:06.371Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f86ec66befc33c10476f5f3558ea79591a92b335 \"HTTP/1.1 201 Created\""}2061gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f86ec66befc33c10476f5f3558ea79591a92b335/statuses, in 0.12 seconds)2062(finished: subtest: eval and build post commit statuses, in 11.39 seconds)2063(finished: run the VM test script, in 249.89 seconds)2064test script finished in 249.92s2065cleanup2066kill QemuMachine (pid 13)2067gitlab # qemu-system-x86_64: terminating on signal 15 from pid 6 (/nix/store/60m4rxhg2fldqaak400c0lry96ijrzqn-python3-3.13.13/bin/python3.13)2068(finished: cleanup, in 1.89 seconds)2069additionally exposed symbols:2070 gitlab,2071 vlan1,2072 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2073[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-07-25T09:19:52.877Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2074[]2075[{'id': 1, 'project_id': 1, 'number': 1, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-07-25T09:19:54.905807Z', 'started_at': None, 'finished_at': None}]2076[]2077[{'id': 1, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-07-25T09:19:55.395Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2078[{'id': 1, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-07-25T09:19:55.395Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2079[{'id': 1, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-07-25T09:19:55.395Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2080[{'id': 1, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-07-25T09:19:55.395Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2081[{'id': 1, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-25T09:19:55.395Z', 'started_at': None, 'finished_at': '2026-07-25T09:20:00.085Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'building attributes', 'created_at': '2026-07-25T09:20:00.377Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2082[{'id': 1, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-25T09:19:55.395Z', 'started_at': None, 'finished_at': '2026-07-25T09:20:00.085Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'building attributes', 'created_at': '2026-07-25T09:20:00.377Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2083[{'id': 1, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-25T09:19:55.395Z', 'started_at': None, 'finished_at': '2026-07-25T09:20:00.085Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'building attributes', 'created_at': '2026-07-25T09:20:00.377Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2084[{'id': 1, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-25T09:19:55.395Z', 'started_at': None, 'finished_at': '2026-07-25T09:20:00.085Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'building attributes', 'created_at': '2026-07-25T09:20:00.377Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2085[{'id': 1, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-25T09:19:55.395Z', 'started_at': None, 'finished_at': '2026-07-25T09:20:00.085Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'f86ec66befc33c10476f5f3558ea79591a92b335', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': '1 attributes built', 'created_at': '2026-07-25T09:20:00.377Z', 'started_at': None, 'finished_at': '2026-07-25T09:20:06.318Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]