vm-test-run-nixbot-gitlab
x86_64-linux.nixbot-gitlab
· build #159
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 13)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.h0VJolhzC8', fmt=raw size=107374182412(finished: start all VMs, in 48.30 seconds)13gitlab # mke2fs 1.47.3 (8-Jul-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: 251205c5-0ca5-4322-8e58-1d9bdcde99d419gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Jun 1 15:51:08 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0ia6kf3bbwazygawdg81hq7wm2a3j72l-nixos-system-gitlab-test/init regInfo=/nix/store/qvgyq20mx22ric7hczljn329gg3gbqym-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 460741196 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.006 MHz processor67gitlab # [ 0.000809] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000876] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002727] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002738] Using GB pages for direct mapping73gitlab # [ 0.002907] RAMDISK: [mem 0xbe4e0000-0xbffcffff]74gitlab # [ 0.002913] ACPI: Early table checksum verification disabled75gitlab # [ 0.002916] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002919] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002923] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002930] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002932] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002934] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002935] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002937] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002939] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002940] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002940] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002941] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002941] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002942] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003154] No NUMA configuration found90gitlab # [ 0.003155] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003157] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005919] Zone ranges:93gitlab # [ 0.005920] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005922] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005923] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005924] Device empty97gitlab # [ 0.005924] Movable zone start for each node98gitlab # [ 0.005925] Early memory node ranges99gitlab # [ 0.005925] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005926] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005927] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005928] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005948] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.006219] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.116921] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.117338] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.117351] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.117382] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.117384] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.117386] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.117387] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.117388] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.117389] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.117391] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.117393] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.117397] TSC deadline timer available117gitlab # [ 0.117401] CPU topo: Max. logical packages: 1118gitlab # [ 0.117402] CPU topo: Max. logical dies: 1119gitlab # [ 0.117402] CPU topo: Max. dies per package: 1120gitlab # [ 0.117406] CPU topo: Max. threads per core: 1121gitlab # [ 0.117406] CPU topo: Num. cores per package: 4122gitlab # [ 0.117407] CPU topo: Num. threads per package: 4123gitlab # [ 0.117407] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.117432] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.117449] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.117452] kvm-guest: setup PV sched yield127gitlab # [ 0.117468] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.117470] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.117471] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.117472] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.117474] Booting paravirtualized kernel on KVM132gitlab # [ 0.117477] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.121931] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.124192] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.124241] kvm-guest: PV spinlocks enabled136gitlab # [ 0.124242] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.124245] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0ia6kf3bbwazygawdg81hq7wm2a3j72l-nixos-system-gitlab-test/init regInfo=/nix/store/qvgyq20mx22ric7hczljn329gg3gbqym-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.124344] Unknown kernel command line parameters "regInfo=/nix/store/qvgyq20mx22ric7hczljn329gg3gbqym-closure-info/registration", will be passed to user space.139gitlab # [ 0.124357] random: crng init done140gitlab # [ 0.124358] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.133441] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.138153] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.138228] software IO TLB: area num 4.144gitlab # [ 0.214479] Fallback order for Node 0: 0145gitlab # [ 0.214486] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.214488] Policy zone: Normal147gitlab # [ 0.217032] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.226543] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.240753] allocated 12582912 bytes of page_ext150gitlab # [ 0.250688] ftrace: allocating 48565 entries in 192 pages151gitlab # [ 0.250689] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.251527] Dynamic Preempt: lazy153gitlab # [ 0.251694] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.251695] rcu: RCU event tracing is enabled.155gitlab # [ 0.251695] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.251697] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.251697] Rude variant of Tasks RCU enabled.158gitlab # [ 0.251698] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.251699] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.251699] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.251725] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.251726] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.251728] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.256381] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.256673] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.256792] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)167gitlab # [ 0.260357] Console: colour VGA+ 80x25168gitlab # [ 0.260359] printk: legacy console [tty0] enabled169gitlab # [ 0.290981] printk: legacy console [ttyS0] enabled170gitlab # [ 0.392043] ACPI: Core revision 20250807171gitlab # [ 0.392988] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns172gitlab # [ 0.394575] APIC: Switch to symmetric I/O mode setup173gitlab # [ 0.395580] x2apic enabled174gitlab # [ 0.396346] APIC: Switched APIC routing to: physical x2apic175gitlab # [ 0.397286] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()176gitlab # [ 0.398514] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()177gitlab # [ 0.400003] kvm-guest: setup PV IPIs178gitlab # [ 0.401572] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1179gitlab # [ 0.402563] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983d4fda2, max_idle_ns: 440795302975 ns180gitlab # [ 0.404298] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400006)181gitlab # [ 0.406380] x86/cpu: User Mode Instruction Prevention (UMIP) activated182gitlab # [ 0.407422] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127183gitlab # [ 0.408295] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0184gitlab # [ 0.409299] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto185gitlab # [ 0.411295] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl186gitlab # [ 0.413295] Transient Scheduler Attacks: Vulnerable: No microcode187gitlab # [ 0.414295] Spectre V2 : Mitigation: Enhanced / Automatic IBRS188gitlab # [ 0.415295] Speculative Return Stack Overflow: Mitigation: Safe RET189gitlab # [ 0.416295] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization190gitlab # [ 0.417299] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier191gitlab # [ 0.419295] active return thunk: srso_alias_return_thunk192gitlab # [ 0.420316] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'193gitlab # [ 0.421295] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'194gitlab # [ 0.422295] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'195gitlab # [ 0.423295] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'196gitlab # [ 0.424295] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'197gitlab # [ 0.425295] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'198gitlab # [ 0.426295] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'199gitlab # [ 0.427296] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256200gitlab # [ 0.428295] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64201gitlab # [ 0.429295] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512202gitlab # [ 0.430295] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024203gitlab # [ 0.431295] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8204gitlab # [ 0.432295] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.205gitlab # [ 0.461527] Freeing SMP alternatives memory: 44K206gitlab # [ 0.462298] pid_max: default: 32768 minimum: 301207gitlab # [ 0.463170] LSM: initializing lsm=capability,landlock,yama,bpf,ima208gitlab # [ 0.464393] landlock: Up and running.209gitlab # [ 0.465034] Yama: becoming mindful.210gitlab # [ 0.465506] LSM support for eBPF active211gitlab # [ 0.466499] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)212gitlab # [ 0.467447] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)213gitlab # [ 0.470706] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)214gitlab # [ 0.471893] Performance Events: Fam17h+ core perfctr, AMD PMU driver.215gitlab # [ 0.472304] ... version: 2216gitlab # [ 0.473059] ... bit width: 48217gitlab # [ 0.473297] ... generic counters: 6218gitlab # [ 0.474073] ... generic bitmap: 000000000000003f219gitlab # [ 0.474992] ... fixed-purpose counters: 0220gitlab # [ 0.475297] ... fixed-purpose bitmap: 0000000000000000221gitlab # [ 0.476218] ... value mask: 0000ffffffffffff222gitlab # [ 0.477034] ... max period: 00007fffffffffff223gitlab # [ 0.477297] ... global_ctrl mask: 000000000000003f224gitlab # [ 0.478348] signal: max sigframe size: 3376225gitlab # [ 0.479180] rcu: Hierarchical SRCU implementation.226gitlab # [ 0.479932] rcu: Max phase no-delay instances is 400.227gitlab # [ 0.480489] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level228gitlab # [ 0.485786] smp: Bringing up secondary CPUs ...229gitlab # [ 0.486696] smpboot: x86: Booting SMP configuration:230gitlab # [ 0.487300] .... node #0, CPUs: #1 #2 #3231gitlab # [ 0.490450] smp: Brought up 1 node, 4 CPUs232gitlab # [ 0.492021] smpboot: Total of 4 processors activated (19200.04 BogoMIPS)233gitlab # [ 0.492634] Memory: 6013420K/6290904K available (17098K kernel code, 2721K rwdata, 13520K rodata, 3644K init, 3008K bss, 258300K reserved, 0K cma-reserved)234gitlab # [ 0.494298] devtmpfs: initialized235gitlab # [ 0.495175] x86/mm: Memory block size: 128MB236gitlab # [ 0.498355] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns237gitlab # [ 0.499346] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)238gitlab # [ 0.500376] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).239gitlab # [ 0.501389] pinctrl core: initialized pinctrl subsystem240gitlab # [ 0.502595] PM: RTC time: 09:38:12, date: 2026-07-25241gitlab # [ 0.506491] NET: Registered PF_NETLINK/PF_ROUTE protocol family242gitlab # [ 0.508717] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations243gitlab # [ 0.509352] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations244gitlab # [ 0.511416] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations245gitlab # [ 0.512309] audit: initializing netlink subsys (disabled)246gitlab # [ 0.513394] audit: type=2000 audit(1784972293.090:1): state=initialized audit_enabled=0 res=1247gitlab # [ 0.513514] thermal_sys: Registered thermal governor 'fair_share'248gitlab # [ 0.515298] thermal_sys: Registered thermal governor 'bang_bang'249gitlab # [ 0.516297] thermal_sys: Registered thermal governor 'step_wise'250gitlab # [ 0.517289] thermal_sys: Registered thermal governor 'user_space'251gitlab # [ 0.518065] thermal_sys: Registered thermal governor 'power_allocator'252gitlab # [ 0.518311] cpuidle: using governor menu253gitlab # [ 0.520507] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5254gitlab # [ 0.521544] PCI: Using configuration type 1 for base access255gitlab # [ 0.522299] PCI: Using configuration type 1 for extended access256gitlab # [ 0.523453] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.257gitlab # [ 0.526600] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages258gitlab # [ 0.527299] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page259gitlab # [ 0.528298] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages260gitlab # [ 0.529298] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page261gitlab # [ 0.534475] ACPI: Added _OSI(Module Device)262gitlab # [ 0.536306] ACPI: Added _OSI(Processor Device)263gitlab # [ 0.538304] ACPI: Added _OSI(Processor Aggregator Device)264gitlab # [ 0.545233] ACPI: 1 ACPI AML tables successfully acquired and loaded265gitlab # [ 0.552569] ACPI: Interpreter enabled266gitlab # [ 0.554362] ACPI: PM: (supports S0 S3 S4 S5)267gitlab # [ 0.555304] ACPI: Using IOAPIC for interrupt routing268gitlab # [ 0.557361] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug269gitlab # [ 0.561306] PCI: Using E820 reservations for host bridge windows270gitlab # [ 0.564646] ACPI: Enabled 2 GPEs in block 00 to 0F271gitlab # [ 0.577270] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])272gitlab # [ 0.579310] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]273gitlab # [ 0.583173] acpiphp: Slot [3] registered274gitlab # [ 0.584323] acpiphp: Slot [4] registered275gitlab # [ 0.585339] acpiphp: Slot [5] registered276gitlab # [ 0.587358] acpiphp: Slot [6] registered277gitlab # [ 0.588342] acpiphp: Slot [7] registered278gitlab # [ 0.589340] acpiphp: Slot [8] registered279gitlab # [ 0.591356] acpiphp: Slot [9] registered280gitlab # [ 0.592341] acpiphp: Slot [10] registered281gitlab # [ 0.594340] acpiphp: Slot [11] registered282gitlab # [ 0.595367] acpiphp: Slot [12] registered283gitlab # [ 0.596354] acpiphp: Slot [13] registered284gitlab # [ 0.598323] acpiphp: Slot [14] registered285gitlab # [ 0.599051] acpiphp: Slot [15] registered286gitlab # [ 0.599317] acpiphp: Slot [16] registered287gitlab # [ 0.600039] acpiphp: Slot [17] registered288gitlab # [ 0.601317] acpiphp: Slot [18] registered289gitlab # [ 0.602055] acpiphp: Slot [19] registered290gitlab # [ 0.602317] acpiphp: Slot [20] registered291gitlab # [ 0.603034] acpiphp: Slot [21] registered292gitlab # [ 0.603319] acpiphp: Slot [22] registered293gitlab # [ 0.604047] acpiphp: Slot [23] registered294gitlab # [ 0.605326] acpiphp: Slot [24] registered295gitlab # [ 0.606042] acpiphp: Slot [25] registered296gitlab # [ 0.606318] acpiphp: Slot [26] registered297gitlab # [ 0.607061] acpiphp: Slot [27] registered298gitlab # [ 0.608327] acpiphp: Slot [28] registered299gitlab # [ 0.609060] acpiphp: Slot [29] registered300gitlab # [ 0.609318] acpiphp: Slot [30] registered301gitlab # [ 0.610049] acpiphp: Slot [31] registered302gitlab # [ 0.611310] PCI host bridge to bus 0000:00303gitlab # [ 0.612007] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]304gitlab # [ 0.613304] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]305gitlab # [ 0.614333] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]306gitlab # [ 0.615288] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]307gitlab # [ 0.616269] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]308gitlab # [ 0.618311] pci_bus 0000:00: root bus resource [bus 00-ff]309gitlab # [ 0.619610] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint310gitlab # [ 0.620857] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint311gitlab # [ 0.622762] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint312gitlab # [ 0.625920] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]313gitlab # [ 0.627326] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk314gitlab # [ 0.628298] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk315gitlab # [ 0.629298] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk316gitlab # [ 0.630298] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk317gitlab # [ 0.631484] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint318gitlab # [ 0.634350] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]319gitlab # [ 0.636454] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint320gitlab # [ 0.638595] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI321gitlab # [ 0.639304] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB322gitlab # [ 0.640522] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint323gitlab # [ 0.656385] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]324gitlab # [ 0.657310] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]325gitlab # [ 0.658320] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]326gitlab # [ 0.659475] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]327gitlab # [ 0.661042] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint328gitlab # [ 0.666330] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]329gitlab # [ 0.667252] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]330gitlab # [ 0.668080] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]331gitlab # [ 0.680284] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]332gitlab # [ 0.683893] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint333gitlab # [ 0.691333] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]334gitlab # [ 0.693321] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]335gitlab # [ 0.695357] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]336gitlab # [ 0.703653] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint337gitlab # [ 0.714342] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]338gitlab # [ 0.717319] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]339gitlab # [ 0.719375] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]340gitlab # [ 0.726356] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint341gitlab # [ 0.736340] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]342gitlab # [ 0.739320] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]343gitlab # [ 0.741370] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]344gitlab # [ 0.746732] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint345gitlab # [ 0.754524] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]346gitlab # [ 0.756023] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]347gitlab # [ 0.757322] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]348gitlab # [ 0.759754] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint349gitlab # [ 0.764334] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]350gitlab # [ 0.766305] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]351gitlab # [ 0.767308] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]352gitlab # [ 0.769580] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint353gitlab # [ 0.773329] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]354gitlab # [ 0.774215] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]355gitlab # [ 0.775067] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]356gitlab # [ 0.777304] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]357gitlab # [ 0.779591] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint358gitlab # [ 0.782310] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]359gitlab # [ 0.783320] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]360gitlab # [ 0.785605] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint361gitlab # [ 0.789306] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]362gitlab # [ 0.790170] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]363gitlab # [ 0.791109] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]364gitlab # [ 0.793451] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint365gitlab # [ 0.798307] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]366gitlab # [ 0.799999] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]367gitlab # [ 0.801320] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]368gitlab # [ 0.806011] ACPI: PCI: Interrupt link LNKA configured for IRQ 10369gitlab # [ 0.807447] ACPI: PCI: Interrupt link LNKB configured for IRQ 10370gitlab # [ 0.808433] ACPI: PCI: Interrupt link LNKC configured for IRQ 11371gitlab # [ 0.810439] ACPI: PCI: Interrupt link LNKD configured for IRQ 11372gitlab # [ 0.811376] ACPI: PCI: Interrupt link LNKS configured for IRQ 9373gitlab # [ 0.814662] iommu: Default domain type: Translated374gitlab # [ 0.815298] iommu: DMA domain TLB invalidation policy: lazy mode375gitlab # [ 0.816580] ACPI: bus type USB registered376gitlab # [ 0.817366] usbcore: registered new interface driver usbfs377gitlab # [ 0.818313] usbcore: registered new interface driver hub378gitlab # [ 0.819423] usbcore: registered new device driver usb379gitlab # [ 0.825207] NetLabel: Initializing380gitlab # [ 0.826303] NetLabel: domain hash size = 128381gitlab # [ 0.828303] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO382gitlab # [ 0.830483] NetLabel: unlabeled traffic allowed by default383gitlab # [ 0.832327] PCI: Using ACPI for IRQ routing384gitlab # [ 0.835425] pci 0000:00:02.0: vgaarb: setting as boot VGA device385gitlab # [ 0.836294] pci 0000:00:02.0: vgaarb: bridge control possible386gitlab # [ 0.836294] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none387gitlab # [ 0.843315] vgaarb: loaded388gitlab # [ 0.844792] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0389gitlab # [ 0.847302] hpet0: 3 comparators, 64-bit 100.000000 MHz counter390gitlab # [ 0.853581] clocksource: Switched to clocksource kvm-clock391gitlab # [ 0.857168] VFS: Disk quotas dquot_6.6.0392gitlab # [ 0.858943] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)393gitlab # [ 0.862299] pnp: PnP ACPI init394gitlab # [ 0.865154] pnp: PnP ACPI: found 6 devices395gitlab # [ 0.878559] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns396gitlab # [ 0.881579] clocksource: Switched to clocksource acpi_pm397gitlab # [ 0.883887] NET: Registered PF_INET protocol family398gitlab # [ 0.887967] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)399gitlab # [ 0.906752] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)400gitlab # [ 0.908288] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)401gitlab # [ 0.909650] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)402gitlab # [ 0.913351] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)403gitlab # [ 0.914717] TCP: Hash tables configured (established 65536 bind 65536)404gitlab # [ 0.915899] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)405gitlab # [ 0.917231] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)406gitlab # [ 0.919046] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.920430] NET: Registered PF_UNIX/PF_LOCAL protocol family408gitlab # [ 0.921419] NET: Registered PF_XDP protocol family409gitlab # [ 0.922304] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]410gitlab # [ 0.923341] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]411gitlab # [ 0.924374] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]412gitlab # [ 0.925521] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]413gitlab # [ 0.926680] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]414gitlab # [ 0.928016] pci 0000:00:01.0: PIIX3: Enabling Passive Release415gitlab # [ 0.929005] pci 0000:00:00.0: Limiting direct PCI/PCI transfers416gitlab # [ 0.931416] ACPI: \_SB_.LNKD: Enabled at IRQ 11417gitlab # [ 0.934004] PCI: CLS 0 bytes, default 64418gitlab # [ 0.934780] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)419gitlab # [ 0.935397] Trying to unpack rootfs image as initramfs...420gitlab # [ 0.935832] software IO TLB: mapped [mem 0x00000000ba4e0000-0x00000000be4e0000] (64MB)421gitlab # [ 0.935956] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983d4fda2, max_idle_ns: 440795302975 ns422gitlab # [ 0.959413] Initialise system trusted keyrings423gitlab # [ 0.960768] workingset: timestamp_bits=40 max_order=21 bucket_order=0424gitlab # [ 0.972240] Key type asymmetric registered425gitlab # [ 0.973026] Asymmetric key parser 'x509' registered426gitlab # [ 0.974207] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)427gitlab # [ 0.976011] io scheduler mq-deadline registered428gitlab # [ 0.976803] io scheduler kyber registered429gitlab # [ 0.982332] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled430gitlab # [ 0.983707] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A431gitlab # [ 0.986894] Linux agpgart interface v0.103432gitlab # [ 0.988936] ACPI: bus type drm_connector registered433gitlab # [ 0.993603] usbcore: registered new interface driver usbserial_generic434gitlab # [ 0.996385] usbserial: USB Serial support registered for generic435gitlab # [ 0.998917] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.436gitlab # [ 0.998917] Please enable it if your BIOS has the CPPC option.437gitlab # [ 1.004578] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled438gitlab # [ 1.008210] drop_monitor: Initializing network drop monitor service439gitlab # [ 1.013435] NET: Registered PF_INET6 protocol family440gitlab # [ 1.017151] Segment Routing with IPv6441gitlab # [ 1.018934] In-situ OAM (IOAM) with IPv6442gitlab # [ 1.023400] IPI shorthand broadcast: enabled443gitlab # [ 1.034522] sched_clock: Marking stable (894031329, 139612951)->(1055266342, -21622062)444gitlab # [ 1.039061] registered taskstats version 1445gitlab # [ 1.041836] Loading compiled-in X.509 certificates446gitlab # [ 1.064596] Demotion targets for Node 0: null447gitlab # [ 1.066785] Key type .fscrypt registered448gitlab # [ 1.068359] Key type fscrypt-provisioning registered449gitlab # [ 1.070809] ima: No TPM chip found, activating TPM-bypass!450gitlab # [ 1.073092] ima: Allocated hash algorithm: sha1451gitlab # [ 1.074786] ima: No architecture policies found452gitlab # [ 1.076757] PM: Magic number: 2:420:627453gitlab # [ 1.079760] RAS: Correctable Errors collector initialized.454gitlab # [ 1.088042] clk: Disabling unused clocks455gitlab # [ 1.088758] PM: genpd: Disabling unused power domains456gitlab # [ 1.215219] Freeing initrd memory: 27584K457gitlab # [ 1.222581] Freeing unused decrypted memory: 2028K458gitlab # [ 1.229004] Freeing unused kernel image (initmem) memory: 3644K459gitlab # [ 1.231707] Write protecting the kernel read-only data: 32768k460gitlab # [ 1.236769] Freeing unused kernel image (text/rodata gap) memory: 1332K461gitlab # [ 1.240780] Freeing unused kernel image (rodata/data gap) memory: 816K462gitlab # [ 1.307265] x86/mm: Checked W+X mappings: passed, no W+X pages found.463gitlab # [ 1.308458] Run /init as init process464gitlab # [ 1.323203] systemd[1]: Inserted module 'autofs4'465gitlab # [ 1.345682] fuse: init (API version 7.45)466gitlab # [ 1.354075] ACPI: \_SB_.LNKC: Enabled at IRQ 10467gitlab # [ 1.361283] ACPI: \_SB_.LNKA: Enabled at IRQ 10468gitlab # [ 1.364517] ACPI: \_SB_.LNKB: Enabled at IRQ 11469gitlab # [ 1.403210] systemd[1]: Successfully made /usr/ read-only.470gitlab # [ 1.739294] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)471gitlab # [ 1.746817] systemd[1]: Detected virtualization kvm.472gitlab # [ 1.777577] systemd[1]: Detected architecture x86-64.473gitlab # [ 1.779767] systemd[1]: Running in initrd.474gitlab # [ 1.782304] systemd[1]: Initializing machine ID from random generator.475gitlab # [ 1.785047] systemd[1]: Hostname set to <gitlab>.476gitlab # [ 1.865417] systemd[1]: Queued start job for default target Initrd Default Target.477gitlab # [ 1.995959] systemd[1]: Created slice Slice /system/modprobe.478gitlab # [ 1.998931] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.479gitlab # [ 2.002418] systemd[1]: Expecting device /dev/disk/by-label/nix-store...480gitlab # [ 2.005266] systemd[1]: Expecting device /dev/disk/by-label/nixos...481gitlab # [ 2.007995] systemd[1]: Reached target Path Units.482gitlab # [ 2.010137] systemd[1]: Reached target Slice Units.483gitlab # [ 2.012358] systemd[1]: Reached target Swaps.484gitlab # [ 2.014406] systemd[1]: Reached target Timer Units.485gitlab # [ 2.016865] systemd[1]: Listening on D-Bus System Message Bus Socket.486gitlab # [ 2.019892] systemd[1]: Listening on Journal Socket (/dev/log).487gitlab # [ 2.022786] systemd[1]: Listening on Journal Sockets.488gitlab # [ 2.025204] systemd[1]: Listening on udev Control Socket.489gitlab # [ 2.027857] systemd[1]: Listening on udev Kernel Socket.490gitlab # [ 2.030097] systemd[1]: Reached target Socket Units.491gitlab # [ 2.036067] systemd[1]: Starting Create List of Static Device Nodes...492gitlab # [ 2.042423] systemd[1]: Starting Load Kernel Module 9pnet_virtio...493gitlab # [ 2.066232] systemd[1]: Starting Load Kernel Module configfs...494gitlab # [ 2.075801] systemd[1]: Starting Journal Service...495gitlab # [ 2.082511] systemd[1]: Starting Load Kernel Modules...496gitlab # [ 2.084458] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki497gitlab # [ 2.092033] systemd[1]: Starting Coldplug All udev Devices...498gitlab # [ 2.109141] systemd[1]: Finished Create List of Static Device Nodes.499gitlab # [ 2.114321] systemd[1]: modprobe@configfs.service: Deactivated successfully.500gitlab # [ 2.119260] systemd-journald[152]: Collecting audit messages is disabled.501gitlab # [ 2.119478] systemd[1]: Finished Load Kernel Module configfs.502gitlab # [ 2.122837] netfs: FS-Cache loaded503gitlab # [ 2.129713] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config504gitlab # [ 2.129757] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.505gitlab # [ 2.132238] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...506gitlab # [ 2.134790] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev507gitlab # [ 2.139825] 9pnet: Installing 9P2000 support508gitlab # [ 2.144010] systemd[1]: Finished Load Kernel Modules.509gitlab # [ 2.145468] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.510gitlab # [ 2.148718] systemd[1]: Finished Load Kernel Module 9pnet_virtio.511gitlab # [ 2.153887] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.512gitlab # [ 2.157393] systemd[1]: Starting Apply Kernel Variables...513gitlab # [ 2.160239] systemd[1]: Starting Create Static Device Nodes in /dev...514gitlab # [ 2.168474] systemd[1]: Started Journal Service.515gitlab # [ 2.028945] systemd-modules-load[154]: Using 4 probe threads516gitlab # [ 2.031271] systemd-modules-load[154]: Inserted module 'virtio_balloon'517gitlab # [ 2.032532] systemd-modules-load[154]: Inserted module 'virtio_gpu'518gitlab # [ 2.033611] systemd-modules-load[154]: Inserted module 'dm_mod'519gitlab # [ 2.036596] systemd[1]: Finished Create Static Device Nodes in /dev.520gitlab # [ 2.039350] systemd[1]: Finished Apply Kernel Variables.521gitlab # [ 2.041262] systemd[1]: Reached target Preparation for Local File Systems.522gitlab # [ 2.042194] systemd[1]: Reached target Local File Systems.523gitlab # [ 2.043766] systemd[1]: Starting Create System Files and Directories...524gitlab # [ 2.045991] systemd[1]: Starting Rule-based Manager for Device Events and Files...525gitlab # [ 2.060607] systemd[1]: Finished Create System Files and Directories.526gitlab # [ 2.067539] systemd-udevd[193]: Using default interface naming scheme 'v260'.527gitlab # [ 2.079065] systemd[1]: Started Rule-based Manager for Device Events and Files.528gitlab # [ 2.109601] systemd[1]: Finished Coldplug All udev Devices.529gitlab # [ 2.110497] systemd[1]: Reached target System Initialization.530gitlab # [ 2.111262] systemd[1]: Reached target Basic System.531gitlab # [ 2.333420] virtio_blk virtio4: 4/0/0 default/read/poll queues532gitlab # [ 2.335510] uhci_hcd 0000:00:01.2: UHCI Host Controller533gitlab # [ 2.337188] SCSI subsystem initialized534gitlab # [ 2.338097] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1535gitlab # [ 2.339296] uhci_hcd 0000:00:01.2: detected 2 ports536gitlab # [ 2.345560] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140537gitlab # [ 2.347433] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18538gitlab # [ 2.348721] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1539gitlab # [ 2.349844] usb usb1: Product: UHCI Host Controller540gitlab # [ 2.350573] usb usb1: Manufacturer: Linux 6.18.34 uhci_hcd541gitlab # [ 2.351413] usb usb1: SerialNumber: 0000:00:01.2542gitlab # [ 2.358218] hub 1-0:1.0: USB hub found543gitlab # [ 2.359079] hub 1-0:1.0: 2 ports detected544gitlab # [ 2.360453] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)545gitlab # [ 2.376314] virtio_blk virtio5: 4/0/0 default/read/poll queues546gitlab # [ 2.384975] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12547gitlab # [ 2.386992] scsi host0: ata_piix548gitlab # [ 2.387691] serio: i8042 KBD port at 0x60,0x64 irq 1549gitlab # [ 2.387701] serio: i8042 AUX port at 0x60,0x64 irq 12550gitlab # [ 2.390893] virtio_blk virtio5: [vdb] 11467656 512-byte logical blocks (5.87 GB/5.47 GiB)551gitlab # [ 2.394328] scsi host1: ata_piix552gitlab # [ 2.395367] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0553gitlab # [ 2.396629] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0554gitlab # [ 2.278537] (udev-worker)[198]: Network interface NamePolicy= disabled on kernel command line.555gitlab # [ 2.280109] (udev-worker)[218]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.556gitlab # [ 2.282263] (udev-worker)[218]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.284374] systemd[1]: Starting Virtual Console Setup...558gitlab # [ 2.297939] systemd[1]: Found device /dev/disk/by-label/nixos.559gitlab # [ 2.299326] systemd[1]: Reached target Initrd Root Device.560gitlab # [ 2.301281] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...561gitlab # [ 2.307375] systemd-vconsole-setup[233]: Configuration of first virtual console was skipped, ignoring remaining ones.562gitlab # [ 2.309199] systemd[1]: Found device /dev/disk/by-label/nix-store.563gitlab # [ 2.311472] systemd[1]: Finished Virtual Console Setup.564gitlab # [ 2.325992] systemd-fsck[241]: nixos: clean, 12/65536 files, 13019/262144 blocks565gitlab # [ 2.330099] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.566gitlab # [ 2.556288] ata2: found unknown device (class 0)567gitlab # [ 2.557573] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100568gitlab # [ 2.560032] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5569gitlab # [ 2.579710] usb 1-1: new full-speed USB device number 2 using uhci_hcd570gitlab # [ 2.595326] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0571gitlab # [ 2.628168] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray572gitlab # [ 2.660741] cdrom: Uniform CD-ROM driver Revision: 3.20573gitlab # [ 2.748026] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00574gitlab # [ 2.751016] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10575gitlab # [ 2.753722] usb 1-1: Product: QEMU USB Tablet576gitlab # [ 2.755409] usb 1-1: Manufacturer: QEMU577gitlab # [ 2.756927] usb 1-1: SerialNumber: 28754-0000:00:01.2-1578gitlab # [ 2.791237] hid: raw HID events driver (C) Jiri Kosina579gitlab # [ 2.805420] usbcore: registered new interface driver usbhid580gitlab # [ 2.807546] usbhid: USB HID core driver581gitlab # [ 2.817918] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2582gitlab # [ 2.821751] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0583gitlab # [ 2.971536] systemd[1]: Mounting /sysroot...584gitlab # [ 3.273132] EXT4-fs (vda): mounted filesystem 251205c5-0ca5-4322-8e58-1d9bdcde99d4 r/w with ordered data mode. Quota mode: none.585gitlab # [ 3.140349] systemd[1]: Mounted /sysroot.586gitlab # [ 3.141345] systemd[1]: Reached target Initrd Root File System.587gitlab # [ 3.146403] systemd[1]: Mounting /sysroot/nix/.ro-store...588gitlab # [ 3.149755] systemd[1]: Mounting /sysroot/nix/.rw-store...589gitlab # [ 3.153311] systemd[1]: Mounting /sysroot/run...590gitlab # [ 3.161259] systemd[1]: Mounting /sysroot/tmp/shared...591gitlab # [ 3.165226] systemd[1]: Mounting /sysroot/tmp/xchg...592gitlab # [ 3.171935] systemd[1]: Starting Mountpoints Configured in the Real Root...593gitlab # [ 3.315133] 9p: Installing v9fs 9p2000 file system support594gitlab # [ 3.178123] systemd[1]: Mounted /sysroot/nix/.rw-store.595gitlab # [ 3.324039] erofs (device vdb): mounted with root inode @ nid 128.596gitlab # [ 3.188080] systemd[1]: Starting rw-sysroot-nix-store.service...597gitlab # [ 3.191554] systemd[1]: Mounted /sysroot/nix/.ro-store.598gitlab # [ 3.192710] systemd-sysroot-fstab-check[272]: /sysroot should be mounted in the initrd, will request daemon-reload.599gitlab # [ 3.194311] systemd[1]: Mounted /sysroot/run.600gitlab # [ 3.195062] systemd[1]: Mounted /sysroot/tmp/shared.601gitlab # [ 3.195976] systemd[1]: Mounted /sysroot/tmp/xchg.602gitlab # [ 3.197856] systemd[1]: Reload requested from client PID 272 ('systemd-sysroot') (unit initrd-parse-etc.service)...603gitlab # [ 3.199505] systemd[1]: Reloading...604gitlab # [ 3.427574] systemd[1]: Reloading finished in 229 ms.605gitlab # [ 3.462970] systemd-sysroot-fstab-check[272]: Requesting initrd-fs.target/start/replace...606gitlab # [ 3.551466] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.607gitlab # [ 3.554464] systemd[1]: Finished rw-sysroot-nix-store.service.608gitlab # [ 3.564286] systemd-sysroot-fstab-check[272]: Requesting swap.target/start/replace...609gitlab # [ 3.570863] systemd[1]: Starting rw-sysroot-nix-store.service...610gitlab # [ 3.573183] systemd[1]: initrd-parse-etc.service: Deactivated successfully.611gitlab # [ 3.577922] systemd[1]: Finished Mountpoints Configured in the Real Root.612gitlab # [ 3.579789] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.613gitlab # [ 3.589628] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.614gitlab # [ 3.592877] systemd[1]: Finished rw-sysroot-nix-store.service.615gitlab # [ 3.971580] systemd[1]: Mounting /sysroot/nix/store...616gitlab # [ 4.025489] systemd[1]: Mounted /sysroot/nix/store.617gitlab # [ 4.028499] systemd[1]: Reached target Initrd File Systems.618gitlab # [ 4.035145] systemd[1]: Starting Find NixOS closure...619gitlab # [ 4.041359] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...620gitlab # [ 4.072470] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.621gitlab # [ 4.076933] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.622gitlab # [ 4.094732] systemd[1]: Finished Find NixOS closure.623gitlab # [ 4.096890] systemd[1]: Reached target Initrd Default Target.624gitlab # [ 4.101443] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...625gitlab # [ 4.134955] systemd[1]: Stopped target Initrd Default Target.626gitlab # [ 4.137228] systemd[1]: Stopped target Basic System.627gitlab # [ 4.139084] systemd[1]: Stopped target Initrd Root Device.628gitlab # [ 4.141422] systemd[1]: Stopped target Path Units.629gitlab # [ 4.143172] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.630gitlab # [ 4.145710] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.631gitlab # [ 4.148310] systemd[1]: Stopped target Slice Units.632gitlab # [ 4.150079] systemd[1]: Stopped target Socket Units.633gitlab # [ 4.151833] systemd[1]: Stopped target System Initialization.634gitlab # [ 4.153961] systemd[1]: Stopped target Swaps.635gitlab # [ 4.155603] systemd[1]: Stopped target Timer Units.636gitlab # [ 4.157279] systemd[1]: dbus.socket: Deactivated successfully.637gitlab # [ 4.159240] systemd[1]: Closed D-Bus System Message Bus Socket.638gitlab # [ 4.161299] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.639gitlab # [ 4.163715] systemd[1]: Stopped Find NixOS closure.640gitlab # [ 4.165382] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio641gitlab # [ 4.168881] systemd[1]: Starting rw-sysroot-nix-store.service...642gitlab # [ 4.170860] systemd[1]: systemd-sysctl.service: Deactivated successfully.643gitlab # [ 4.172933] systemd[1]: Stopped Apply Kernel Variables.644gitlab # [ 4.174686] systemd[1]: systemd-modules-load.service: Deactivated successfully.645gitlab # [ 4.176577] systemd[1]: Stopped Load Kernel Modules.646gitlab # [ 4.177948] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.647gitlab # [ 4.179990] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.648gitlab # [ 4.182063] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.649gitlab # [ 4.183996] systemd[1]: Stopped Create System Files and Directories.650gitlab # [ 4.186694] systemd[1]: Stopped target Local File Systems.651gitlab # [ 4.188195] systemd[1]: Stopped target Preparation for Local File Systems.652gitlab # [ 4.190068] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.653gitlab # [ 4.191956] systemd[1]: Stopped Coldplug All udev Devices.654gitlab # [ 4.193868] systemd[1]: Stopping Rule-based Manager for Device Events and Files...655gitlab # [ 4.195142] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.656gitlab # [ 4.196223] systemd[1]: Stopped Virtual Console Setup.657gitlab # [ 4.203871] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.658gitlab # [ 4.205674] systemd[1]: Finished rw-sysroot-nix-store.service.659gitlab # [ 4.210556] systemd[1]: systemd-udevd.service: Deactivated successfully.660gitlab # [ 4.213193] systemd[1]: Stopped Rule-based Manager for Device Events and Files.661gitlab # [ 4.222351] systemd[1]: initrd-cleanup.service: Deactivated successfully.662gitlab # [ 4.223938] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.663gitlab # [ 4.229098] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.664gitlab # [ 4.230325] systemd[1]: Closed udev Control Socket.665gitlab # [ 4.234161] systemd[1]: Starting Cleanup udev Database...666gitlab # [ 4.235267] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.667gitlab # [ 4.236583] systemd[1]: Stopped Create Static Device Nodes in /dev.668gitlab # [ 4.240220] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.669gitlab # [ 4.241472] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.670gitlab # [ 4.242631] systemd[1]: kmod-static-nodes.service: Deactivated successfully.671gitlab # [ 4.243755] systemd[1]: Stopped Create List of Static Device Nodes.672gitlab # [ 4.263725] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.673gitlab # [ 4.266144] systemd[1]: Finished Cleanup udev Database.674gitlab # [ 4.269144] systemd[1]: Reached target Switch Root.675gitlab # [ 4.271449] systemd[1]: Starting NixOS Activation...676gitlab # [ 4.392117] initrd-nixos-activation-start[570]: booting system configuration /nix/store/0ia6kf3bbwazygawdg81hq7wm2a3j72l-nixos-system-gitlab-test677gitlab # [ 4.437734] initrd-nixos-activation-start[570]: running activation script...678gitlab # [ 4.663644] initrd-nixos-activation-start[593]: setting up /etc...679gitlab # [ 4.789217] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.680gitlab # [ 4.793580] systemd[1]: Finished NixOS Activation.681gitlab # [ 4.804352] systemd[1]: Starting Switch Root...682gitlab # [ 4.835870] systemd[1]: Switching root.683gitlab # [ 5.295031] systemd-journald[152]: Received SIGTERM from PID 1 (systemd).684gitlab # [ 5.421222] NET: Registered PF_VSOCK protocol family685gitlab # [ 5.784711] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)686gitlab # [ 5.791049] systemd[1]: Detected virtualization kvm.687gitlab # [ 5.792872] systemd[1]: Detected architecture x86-64.688gitlab # [ 5.794837] systemd[1]: Detected first boot.689gitlab # [ 5.797429] systemd[1]: Initializing machine ID from random generator.690gitlab # [ 5.939252] systemd[1]: bpf-restrict-fs: LSM BPF program attached691gitlab # [ 5.998137] systemd[1]: Applying preset policy.692gitlab # [ 6.164626] systemd[1]: Populated /etc with preset unit settings.693gitlab # [ 6.264682] systemd[1]: initrd-switch-root.service: Deactivated successfully.694gitlab # [ 6.266085] systemd[1]: Stopped initrd-switch-root.service.695gitlab # [ 6.268172] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.696gitlab # [ 6.270299] systemd[1]: Created slice Slice /system/getty.697gitlab # [ 6.271979] systemd[1]: Created slice GitLab DevOps Platform Slice.698gitlab # [ 6.273466] systemd[1]: Created slice User and Session Slice.699gitlab # [ 6.274450] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.700gitlab # [ 6.275799] systemd[1]: Started Forward Password Requests to Wall Directory Watch.701gitlab # [ 6.276955] systemd[1]: Expecting device /dev/hvc0...702gitlab # [ 6.277701] systemd[1]: Expecting device /dev/ttyS0...703gitlab # [ 6.278563] systemd[1]: Reached target Local Encrypted Volumes.704gitlab # [ 6.279526] systemd[1]: Stopped target initrd-fs.target.705gitlab # [ 6.280398] systemd[1]: Stopped target initrd-root-fs.target.706gitlab # [ 6.281309] systemd[1]: Stopped target initrd-switch-root.target.707gitlab # [ 6.282705] systemd[1]: Reached target Virtual Machines and Containers.708gitlab # [ 6.283751] systemd[1]: Reached target Path Units.709gitlab # [ 6.284479] systemd[1]: Reached target Remote File Systems.710gitlab # [ 6.285384] systemd[1]: Reached target Slice Units.711gitlab # [ 6.286244] systemd[1]: Reached target Swaps.712gitlab # [ 6.287888] systemd[1]: Listening on Process Core Dump Socket.713gitlab # [ 6.289306] systemd[1]: Listening on Credential Encryption/Decryption.714gitlab # [ 6.291719] systemd[1]: Starting Journal Log Access Socket...715gitlab # [ 6.293106] systemd[1]: Listening on Journal Audit Socket.716gitlab # [ 6.294196] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.717gitlab # [ 6.295400] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki718gitlab # [ 6.296967] systemd[1]: Listening on udev Control Socket.719gitlab # [ 6.301667] systemd[1]: Mounting Huge Pages File System...720gitlab # [ 6.303652] systemd[1]: Mounting POSIX Message Queue File System...721gitlab # [ 6.305819] systemd[1]: Mounting Kernel Debug File System...722gitlab # [ 6.307843] systemd[1]: Mounting Kernel Trace File System...723gitlab # [ 6.316771] systemd[1]: Starting Create List of Static Device Nodes...724gitlab # [ 6.317934] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio725gitlab # [ 6.322760] systemd[1]: Starting Load Kernel Module configfs...726gitlab # [ 6.325257] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm727gitlab # [ 6.330680] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore728gitlab # [ 6.334826] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse729gitlab # [ 6.341212] systemd[1]: Mounting FUSE Control File System...730gitlab # [ 6.343591] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67731gitlab # [ 6.361283] systemd[1]: Starting Journal Service...732gitlab # [ 6.365807] systemd[1]: Starting Load Kernel Modules...733gitlab # [ 6.368488] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...734gitlab # [ 6.371895] systemd[1]: Starting Remount Root and Kernel File Systems...735gitlab # [ 6.374449] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki736gitlab # [ 6.385851] systemd[1]: Starting Coldplug All udev Devices...737gitlab # [ 6.404692] systemd-journald[789]: Collecting audit messages is enabled.738gitlab # [ 6.416769] EXT4-fs (vda): re-mounted 251205c5-0ca5-4322-8e58-1d9bdcde99d4.739gitlab # [ 6.422725] systemd[1]: Listening on Journal Log Access Socket.740gitlab # [ 6.424743] systemd[1]: Mounted Huge Pages File System.741gitlab # [ 6.426657] systemd[1]: Mounted POSIX Message Queue File System.742gitlab # [ 6.287755] systemd[1]: Queued start job for default target Multi-User System.743gitlab # [ 6.429647] loop: module loaded744gitlab # [ 6.291255] systemd[1]: Unnecessary job was removed for /dev/vdb.745gitlab # [ 6.430561] systemd[1]: Started Journal Service.746gitlab # [ 6.293302] systemd[1]: systemd-journald.service: Deactivated successfully.747gitlab # [ 6.295517] systemd-modules-load[790]: Using 3 probe threads748gitlab # [ 6.299367] systemd-modules-load[790]: Inserted module 'loop'749gitlab # [ 6.300350] systemd[1]: Mounted Kernel Debug File System.750gitlab # [ 6.302287] systemd[1]: Mounted Kernel Trace File System.751gitlab # [ 6.303330] systemd[1]: Finished Create List of Static Device Nodes.752gitlab # [ 6.304632] systemd[1]: modprobe@configfs.service: Deactivated successfully.753gitlab # [ 6.307176] systemd-modules-load[790]: Inserted module 'tls'754gitlab # [ 6.308227] systemd[1]: Finished Load Kernel Module configfs.755gitlab # [ 6.309218] systemd[1]: Mounted FUSE Control File System.756gitlab # [ 6.310055] systemd[1]: Finished Remount Root and Kernel File Systems.757gitlab # [ 6.310950] systemd[1]: Finished Load Kernel Modules.758gitlab # [ 6.311898] systemd-oomd[791]: No swap; memory pressure usage will be degraded759gitlab # [ 6.313267] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.760gitlab # [ 6.316281] systemd[1]: Mounting Kernel Configuration File System...761gitlab # [ 6.318126] systemd[1]: Starting Firewall...762gitlab # [ 6.325212] systemd[1]: Starting Flush Journal to Persistent Storage...763gitlab # [ 6.327055] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore764gitlab # [ 6.328832] systemd[1]: Starting Load/Save OS Random Seed...765gitlab # [ 6.330735] systemd[1]: Starting Apply Kernel Variables...766gitlab # [ 6.333119] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...767gitlab # [ 6.336108] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki768gitlab # [ 6.337496] systemd[1]: Mounted Kernel Configuration File System.769gitlab # [ 6.480883] systemd-journald[789]: Received client request to flush runtime journal.770gitlab # [ 6.384422] systemd[1]: Finished Apply Kernel Variables.771gitlab # [ 6.385426] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.772gitlab # [ 6.387108] systemd[1]: Starting Create Static Device Nodes in /dev...773gitlab # [ 6.388257] systemd[1]: Finished Load/Save OS Random Seed.774gitlab # [ 6.389153] systemd[1]: Reached target First Boot Complete.775gitlab # [ 6.389980] systemd[1]: Finished Create Static Device Nodes in /dev.776gitlab # [ 6.390919] systemd[1]: Reached target Preparation for Local File Systems.777gitlab # [ 6.391927] systemd[1]: Starting Rule-based Manager for Device Events and Files...778gitlab # [ 6.393057] systemd[1]: Finished Flush Journal to Persistent Storage.779gitlab # [ 6.416342] systemd-udevd[833]: Using default interface naming scheme 'v260'.780gitlab # [ 6.446221] systemd[1]: Started Rule-based Manager for Device Events and Files.781gitlab # [ 6.453584] systemd[1]: Finished Coldplug All udev Devices.782gitlab # [ 6.519436] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse783gitlab # [ 6.538870] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.784gitlab # [ 6.551398] (udev-worker)[908]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.785gitlab # [ 6.555068] (udev-worker)[908]: Network interface NamePolicy= disabled on kernel command line.786gitlab # [ 6.556372] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.787gitlab # [ 6.557535] systemd[1]: Finished Firewall.788gitlab # [ 6.568541] systemd[1]: Condition check resulted in Virtio network device being skipped.789gitlab # [ 6.569914] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore790gitlab # [ 6.571603] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67791gitlab # [ 6.574119] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore792gitlab # [ 6.576381] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki793gitlab # [ 6.577736] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki794gitlab # [ 6.579286] (udev-worker)[891]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 6.740306] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3796gitlab # [ 6.745682] ACPI: button: Power Button [PWRF]797gitlab # [ 6.771497] rtc_cmos 00:05: RTC can wake from S4798gitlab # [ 6.774906] rtc_cmos 00:05: registered as rtc0799gitlab # [ 6.775167] Floppy drive(s): fd0 is 2.88M AMI BIOS800gitlab # [ 6.775857] rtc_cmos 00:05: setting system clock to 2026-07-25T09:38:19 UTC (1784972299)801gitlab # [ 6.782301] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs802gitlab # [ 6.785869] parport_pc 00:03: reported by Plug and Play ACPI803gitlab # [ 6.787190] FDC 0 is a S82078B804gitlab # [ 6.787812] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]805gitlab # [ 6.794744] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0806gitlab # [ 6.795946] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD807gitlab # [ 6.798422] mousedev: PS/2 mouse device common for all mice808gitlab # [ 6.801007] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console809gitlab # [ 6.816523] Console: switching to colour dummy device 80x25810gitlab # [ 6.820127] [drm] Found bochs VGA, ID 0xb0c5.811gitlab # [ 6.820660] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.812gitlab # [ 6.822707] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic813gitlab # [ 6.823535] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0814gitlab # [ 6.823864] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4815gitlab # [ 6.831461] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6816gitlab # [ 6.832550] fbcon: bochs-drmdrmfb (fb0) is primary device817gitlab # [ 6.842202] Console: switching to colour frame buffer device 160x50818gitlab # [ 6.847155] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device819gitlab # [ 6.856545] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5820gitlab # [ 6.732224] systemd[1]: Starting Virtual Console Setup...821gitlab # [ 6.893911] ppdev: user-space parallel port driver822gitlab # [ 6.767769] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.823gitlab # [ 6.768902] systemd[1]: Stopped Virtual Console Setup.824gitlab # [ 6.785954] systemd[1]: Starting Virtual Console Setup...825gitlab # [ 6.811748] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.826gitlab # [ 6.812869] systemd[1]: Stopped Virtual Console Setup.827gitlab # [ 6.816100] systemd[1]: Starting Virtual Console Setup...828gitlab # [ 6.971112] kvm_amd: TSC scaling supported829gitlab # [ 6.971549] kvm_amd: Nested Virtualization enabled830gitlab # [ 6.972170] kvm_amd: Nested Paging enabled831gitlab # [ 6.972683] kvm_amd: LBR virtualization supported832gitlab # [ 6.973245] kvm_amd: Virtual VMLOAD VMSAVE supported833gitlab # [ 6.973844] kvm_amd: Virtual GIF supported834gitlab # [ 6.974295] kvm_amd: Virtual NMI enabled835gitlab # [ 7.007102] EDAC MC: Ver: 3.0.0836gitlab # [ 6.885106] systemd-vconsole-setup[962]: Configuration of first virtual console was skipped, ignoring remaining ones.837gitlab # [ 6.887932] systemd[1]: Finished Virtual Console Setup.838gitlab # [ 7.130154] systemd[1]: Mounting /run/wrappers...839gitlab # [ 7.159144] systemd[1]: Mounted /run/wrappers.840gitlab # [ 7.161190] systemd[1]: Reached target Local File Systems.841gitlab # [ 7.163103] systemd[1]: Listening on Boot Loader Control Service Socket.842gitlab # [ 7.165625] systemd[1]: Starting register-nix-paths.service...843gitlab # [ 7.167946] systemd[1]: Starting Create SUID/SGID Wrappers...844gitlab # [ 7.169923] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.845gitlab # [ 7.172798] systemd[1]: Starting Save Transient machine-id to Disk...846gitlab # [ 7.177222] systemd[1]: Starting Create System Files and Directories...847gitlab # [ 7.210322] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.848gitlab # [ 7.213562] systemd[1]: Finished Save Transient machine-id to Disk.849gitlab # [ 7.229934] systemd[1]: Finished Create System Files and Directories.850gitlab # [ 7.232643] systemd[1]: Starting Rebuild Journal Catalog...851gitlab # [ 7.234560] systemd[1]: Starting Record System Boot/Shutdown in UTMP...852gitlab # [ 7.255920] systemd[1]: Finished Record System Boot/Shutdown in UTMP.853gitlab # [ 7.273627] systemd[1]: Finished Rebuild Journal Catalog.854gitlab # [ 7.276101] systemd[1]: Starting Update is Completed...855gitlab # [ 7.295197] systemd[1]: Finished Update is Completed.856gitlab # [ 7.340777] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.857gitlab # [ 7.342650] systemd[1]: Finished Create SUID/SGID Wrappers.858gitlab # [ 7.344027] systemd[1]: suid-sgid-wrappers.service: Consumed 141ms CPU time over 172ms wall clock time, 4.5M memory peak, 1.1M read from disk.859gitlab # [ 7.601608] systemd[1]: Finished register-nix-paths.service.860gitlab # [ 7.603551] systemd[1]: Reached target System Initialization.861gitlab # [ 7.605340] systemd[1]: Started Discard unused filesystem blocks once a week.862gitlab # [ 7.607551] systemd[1]: Started logrotate.timer.863gitlab # [ 7.608981] systemd[1]: Started Daily Cleanup of Temporary Directories.864gitlab # [ 7.610988] systemd[1]: Reached target Timer Units.865gitlab # [ 7.612541] systemd[1]: Listening on D-Bus System Message Bus Socket.866gitlab # [ 7.614468] systemd[1]: Listening on Nix Daemon Socket.867gitlab # [ 7.623357] systemd[1]: Starting nixbot CI service socket...868gitlab # [ 7.625149] systemd[1]: Listening on Hostname Service Socket.869gitlab # [ 7.629318] systemd[1]: Starting D-Bus System Message Bus...870gitlab # [ 7.631621] systemd[1]: Listening on nixbot CI service socket.871gitlab # [ 7.633668] systemd[1]: Reached target Socket Units.872gitlab # [ 7.664669] dbus-broker-launch[1052]: Looking up NSS user entry for 'systemd-timesync'...873gitlab # [ 7.667659] dbus-broker-launch[1052]: NSS returned no entry for 'systemd-timesync'874gitlab # [ 7.670485] dbus-broker-launch[1052]: Invalid user-name in /nix/store/89zj9nmrajvcy9c3c08wv0ir9ww7lgmq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"875gitlab # [ 7.676111] systemd[1]: Started D-Bus System Message Bus.876gitlab # [ 7.686869] dbus-broker-launch[1052]: Ready877gitlab # [ 7.690767] systemd[1]: Reached target Basic System.878gitlab # [ 7.693555] systemd[1]: Started backdoor.service.879gitlab # [ 7.697372] systemd[1]: Starting gitlab-config.service...880gitlab # [ 7.699338] systemd[1]: Starting Import lastlog data into lastlog2 database...881gitlab # [ 7.701766] systemd[1]: Starting Logrotate configuration check...882gitlab # [ 7.704812] systemd[1]: Starting Name Service Cache Daemon (nsncd)...883gitlab # [ 7.717055] logrotate[1057]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.884gitlab # [ 7.721823] logrotate[1057]: reading config file /nix/store/sn4bd2nqi3yg4r51djm9i2rmfgbwvmhb-logrotate.conf885gitlab # [ 7.724928] logrotate[1057]: note: 'monthly' overrides previously specified 'weekly'886gitlab # [ 7.728642] logrotate[1057]: Reading state from file: /var/lib/logrotate.status887gitlab # connecting to host...888gitlab # [ 7.732409] logrotate[1057]: state file /var/lib/logrotate.status does not exist889gitlab # [ 7.734520] logrotate[1057]: Allocating hash table for state file, size 64 entries890gitlab # [ 7.736631] logrotate[1057]: Handling 4 logs891gitlab # [ 7.737873] logrotate[1057]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed892gitlab: Guest shell says: b'Spawning backdoor root shell...\n'893gitlab: connected to guest root shell894gitlab # [ 7.742300] logrotate[1057]: considering log /var/log/btmp895gitlab: (connecting took 8.35 seconds)896gitlab # [ 7.743965] logrotate[1057]: Creating new state897gitlab: (finished: waiting for the VM to finish booting, in 8.35 seconds)898gitlab # [ 7.744780] logrotate[1057]: Now: 2026-07-25 09:38899gitlab # [ 7.745705] logrotate[1057]: Last rotated at 2026-07-25 09:00900gitlab # [ 7.746956] logrotate[1057]: log does not need rotating (log has already been rotated)901gitlab # [ 7.748178] logrotate[1057]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed902gitlab # [ 7.749141] logrotate[1057]: considering log /var/log/wtmp903gitlab # [ 7.749949] logrotate[1057]: Creating new state904gitlab # [ 7.754116] logrotate[1057]: Now: 2026-07-25 09:38905gitlab # [ 7.754441] logrotate[1057]: Last rotated at 2026-07-25 09:00906gitlab # [ 7.754908] logrotate[1057]: log does not need rotating (log has already been rotated)907gitlab # [ 7.755554] logrotate[1057]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed908gitlab # [ 7.756186] logrotate[1057]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1057)909gitlab # [ 7.756613] logrotate[1057]: considering log /var/gitlab/state/log/*.log910gitlab # [ 7.757250] logrotate[1057]: log /var/gitlab/state/log/*.log does not exist -- skipping911gitlab # [ 7.758525] logrotate[1057]: Creating new state912gitlab # [ 7.759142] logrotate[1057]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1057)913gitlab # [ 7.759625] logrotate[1057]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed914gitlab # [ 7.761091] logrotate[1057]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1057)915gitlab # [ 7.761674] logrotate[1057]: considering log /var/log/nginx/*.log916gitlab # [ 7.762155] logrotate[1057]: log /var/log/nginx/*.log does not exist -- skipping917gitlab # [ 7.762624] logrotate[1057]: Creating new state918gitlab # [ 7.763107] logrotate[1057]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1057)919gitlab # [ 7.763767] systemd[1]: Starting Post-Boot Actions...920gitlab # [ 7.765525] systemd[1]: Started Reset console on configuration changes.921gitlab # [ 7.766241] nsncd[1058]: Jul 25 09:38:20.628 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"922gitlab # [ 7.766959] systemd[1]: Starting resolvconf update...923gitlab # [ 7.767714] systemd[1]: Finished Logrotate configuration check.924gitlab # [ 7.773503] systemd[1]: Started Name Service Cache Daemon (nsncd).925gitlab # [ 7.774483] systemd[1]: Finished Post-Boot Actions.926gitlab # [ 7.776378] systemd[1]: Finished Import lastlog data into lastlog2 database.927gitlab # [ 7.781651] systemd[1]: Reached target Host and Network Name Lookups.928gitlab # [ 7.782156] systemd[1]: Reached target User and Group Name Lookups.929gitlab # [ 7.786356] systemd[1]: Starting User Login Management...930gitlab # [ 7.816658] systemd[1]: Stopped target Host and Network Name Lookups.931gitlab # [ 7.817720] systemd[1]: Stopping Host and Network Name Lookups...932gitlab # [ 7.818638] systemd[1]: Stopped target User and Group Name Lookups.933gitlab # [ 7.819714] systemd[1]: Stopping User and Group Name Lookups...934gitlab # [ 7.820600] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...935gitlab # [ 7.821602] systemd[1]: nscd.service: Deactivated successfully.936gitlab # [ 7.822431] systemd[1]: Stopped Name Service Cache Daemon (nsncd).937gitlab # [ 7.823313] systemd[1]: nscd.service: Consumed 25ms CPU time over 115ms wall clock time, 8.3M memory peak, 5.7M read from disk.938gitlab # [ 7.825083] systemd[1]: Starting Name Service Cache Daemon (nsncd)...939gitlab # [ 7.827163] systemd-logind[1094]: New seat seat0.940gitlab # [ 7.828693] systemd-logind[1094]: Watching system buttons on /dev/input/event2 (Power Button)941gitlab # [ 7.829698] systemd-logind[1094]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)942gitlab # [ 7.829846] systemd-logind[1094]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)943gitlab # [ 7.832177] systemd[1]: Started User Login Management.944gitlab # [ 7.836726] systemd[1]: Starting linger-users.service...945gitlab # [ 7.845965] systemd[1]: Started Name Service Cache Daemon (nsncd).946gitlab # [ 7.847205] nsncd[1144]: Jul 25 09:38:20.709 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"947gitlab # [ 7.849394] systemd[1]: Finished resolvconf update.948gitlab # [ 7.850165] systemd[1]: Reached target Preparation for Network.949gitlab # [ 7.850983] systemd[1]: Reached target Host and Network Name Lookups.950gitlab # [ 7.851994] systemd[1]: Reached target User and Group Name Lookups.951gitlab # [ 7.852959] systemd[1]: Starting DHCP Client...952gitlab # [ 7.853705] systemd[1]: Starting Address configuration of eth1...953gitlab # [ 7.856102] systemd[1]: Starting Extra networking commands....954gitlab # [ 7.856620] systemd[1]: linger-users.service: Deactivated successfully.955gitlab # [ 7.856922] systemd[1]: Finished linger-users.service.956gitlab # [ 7.881603] network-addresses-eth1-start[1169]: adding address 192.168.1.1/24... done957gitlab # [ 7.884273] network-addresses-eth1-start[1169]: adding address 2001:db8:1::1/64... done958gitlab # [ 7.889479] systemd[1]: Finished Address configuration of eth1.959gitlab # [ 7.911371] systemd[1]: Finished Extra networking commands..960gitlab # [ 7.912514] systemd[1]: Reached target Network.961gitlab # [ 7.913961] systemd[1]: Starting gitlab-workhorse.service...962gitlab # [ 7.914810] dhcpcd[1176]: dhcpcd-10.3.2 starting963gitlab # [ 7.917416] dhcpcd[1229]: dev: loaded udev964gitlab # [ 7.920105] systemd[1]: Starting Nginx Web Server...965gitlab # [ 7.921249] systemd[1]: Starting PostgreSQL Server...966gitlab # [ 8.062880] 8021q: 802.1Q VLAN Support v1.8967gitlab # [ 8.063404] 8021q: adding VLAN 0 to HW filter on device eth1968gitlab # [ 7.925612] systemd[1]: Starting Redis Server - redis-gitlab...969gitlab # [ 7.927309] systemd[1]: Starting Permit User Sessions...970gitlab # [ 7.935677] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.971gitlab # [ 7.944838] systemd[1]: Finished Permit User Sessions.972gitlab # [ 7.947925] systemd[1]: Started Getty on tty1.973gitlab # [ 7.949480] systemd[1]: Reached target Login Prompts.974gitlab # [ 8.165017] cfg80211: Loading compiled-in X.509 certificates for regulatory database975gitlab # [ 8.173869] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'976gitlab # [ 8.175167] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'977gitlab # [ 8.036062] nginx-pre-start[1253]: nginx: the configuration file /nix/store/nlpb2pnbsk0921apk[ 8.177074] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2978gitlab # v5yml2qxbm30d7w-[ 8.178170] cfg80211: failed to load regulatory.db979gitlab # nginx.conf syntax is ok980gitlab # [ 8.038055] nginx-pre-start[1253]: nginx: configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf test is successful981gitlab # [ 8.044240] systemd[1]: Started Nginx Web Server.982gitlab # [ 8.056226] postgresql-pre-start[1255]: The files belonging to this database system will be owned by user "postgres".983gitlab # [ 8.056810] postgresql-pre-start[1255]: This user must also own the server process.984gitlab # [ 8.062128] postgresql-pre-start[1255]: The database cluster will be initialized with locale "en_US.UTF-8".985gitlab # [ 8.062434] postgresql-pre-start[1255]: The default database encoding has accordingly been set to "UTF8".986gitlab # [ 8.062874] postgresql-pre-start[1255]: The default text search configuration will be set to "english".987gitlab # [ 8.063377] postgresql-pre-start[1255]: Data page checksums are disabled.988gitlab # [ 8.063944] postgresql-pre-start[1255]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok989gitlab # [ 8.064686] postgresql-pre-start[1255]: creating subdirectories ... ok990gitlab # [ 8.068670] postgresql-pre-start[1255]: selecting dynamic shared memory implementation ... posix991gitlab # [ 8.221465] 8021q: adding VLAN 0 to HW filter on device eth0992gitlab # [ 8.084326] dhcpcd[1229]: eth0: waiting for carrier993gitlab # [ 8.085268] dhcpcd[1229]: eth0: carrier acquired994gitlab # [ 8.088337] redis-server[1251]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.995gitlab # [ 8.090541] redis-server[1251]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo996gitlab # [ 8.091882] systemd[1]: Started Redis Server - redis-gitlab.997gitlab # [ 8.092861] redis-server[1251]: Redis version=8.8.0, bits=64, commit=00000000, modified=0, pid=1251, just started998gitlab # [ 8.094519] redis-server[1251]: Configuration loaded999gitlab # [ 8.095649] redis[1251]: monotonic clock: POSIX clock_gettime1000gitlab # [ 8.096682] redis[1251]: Running mode=standalone, port=0.1001gitlab # [ 8.097776] redis[1251]: Server initialized1002gitlab # [ 8.098691] redis[1251]: Ready to accept connections unix1003gitlab # [ 8.099623] redis[1251]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1004gitlab # [ 8.101537] dhcpcd[1229]: DUID 00:01:00:01:31:f7:40:8c:52:54:00:12:34:561005gitlab # [ 8.102529] dhcpcd[1229]: eth0: IAID 00:12:34:561006gitlab # [ 8.103290] dhcpcd[1229]: eth0: adding address fe80::5054:ff:fe12:34561007gitlab # [ 8.111739] postgresql-pre-start[1255]: selecting default "max_connections" ... 1001008gitlab # [ 8.155542] postgresql-pre-start[1255]: selecting default "shared_buffers" ... 128MB1009gitlab # [ 8.350103] systemd[1]: Started gitlab-workhorse.service.1010gitlab # [ 8.502519] postgresql-pre-start[1255]: selecting default time zone ... UTC1011gitlab # [ 8.504467] postgresql-pre-start[1255]: creating configuration files ... ok1012gitlab # [ 8.546062] gitlab-workhorse[1288]: time="2026-07-25T09:38:21Z" level=info msg=Starting build_time=19700101.000000 version=18.11.41013gitlab # [ 8.546428] gitlab-workhorse[1288]: time="2026-07-25T09:38:21Z" level=info msg="Using redis/go-redis"1014gitlab # [ 8.546856] gitlab-workhorse[1288]: time="2026-07-25T09:38:21Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1015gitlab # [ 8.676584] postgresql-pre-start[1255]: running bootstrap script ... ok1016gitlab # [ 9.102375] postgresql-pre-start[1255]: performing post-bootstrap initialization ... ok1017gitlab # [ 9.354465] postgresql-pre-start[1255]: syncing data to disk ... ok1018gitlab # [ 9.354845] postgresql-pre-start[1255]: initdb: warning: enabling "trust" authentication for local connections1019gitlab # [ 9.356396] postgresql-pre-start[1255]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1020gitlab # [ 9.357902] postgresql-pre-start[1255]: Success. You can now start the database server using:1021gitlab # [ 9.359527] postgresql-pre-start[1255]: pg_ctl -D /var/lib/postgresql/17 -l logfile start1022gitlab # [ 9.480104] postgres[1314]: [1314] LOG: starting PostgreSQL 17.10 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1023gitlab # [ 9.484448] postgres[1314]: [1314] LOG: listening on IPv6 address "::1", port 54321024gitlab # [ 9.487224] postgres[1314]: [1314] LOG: listening on IPv4 address "127.0.0.1", port 54321025gitlab # [ 9.490116] postgres[1314]: [1314] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1026gitlab # [ 9.493520] postgres[1324]: [1324] LOG: database system was shut down at 2026-07-25 09:38:21 GMT1027gitlab # [ 9.500892] postgres[1314]: [1314] LOG: database system is ready to accept connections1028gitlab # [ 9.508350] systemd[1]: Started PostgreSQL Server.1029gitlab # [ 9.510660] systemd[1]: Starting PostgreSQL Setup Scripts...1030gitlab # [ 9.526326] dhcpcd[1229]: eth0: soliciting an IPv6 router1031gitlab # [ 9.528390] dhcpcd[1229]: eth0: Router Advertisement from fe80::21032gitlab # [ 9.530716] dhcpcd[1229]: eth0: adding address fec0::5054:ff:fe12:3456/641033gitlab # [ 9.533352] dhcpcd[1229]: eth0: adding route to fec0::/641034gitlab # [ 9.533940] dhcpcd[1229]: eth0: adding default route via fe80::21035gitlab # [ 9.541309] dhcpcd[1229]: eth0: soliciting a DHCP lease1036gitlab # [ 9.691446] NET: Registered PF_PACKET protocol family1037gitlab # [ 9.559150] dhcpcd[1229]: eth0: offered 10.0.2.15 from 10.0.2.21038gitlab # [ 9.567136] dhcpcd[1229]: eth0: probing address 10.0.2.15/241039gitlab # [ 9.630597] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1321]: mkdir -p /var/gitlab/state/home/.ssh: OK1040gitlab # [ 9.635756] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1321]: chmod 700 /var/gitlab/state/home/.ssh: OK1041gitlab # [ 9.667028] postgresql-setup-start[1338]: CREATE DATABASE1042gitlab # [ 9.683118] systemd[1]: Finished gitlab-config.service.1043gitlab # [ 9.685900] systemd[1]: Started gitaly.service.1044gitlab # [ 9.693280] postgresql-setup-start[1354]: CREATE ROLE1045gitlab # [ 9.704455] postgresql-setup-start[1358]: ALTER DATABASE1046gitlab # [ 9.726230] postgresql-setup-start[1364]: CREATE ROLE1047gitlab # [ 9.727786] systemd[1]: Finished PostgreSQL Setup Scripts.1048gitlab # [ 9.728439] systemd[1]: Reached target PostgreSQL.1049gitlab # [ 9.729758] systemd[1]: Starting gitlab-db-config.service...1050gitlab # [ 9.730935] systemd[1]: Starting gitlab-postgresql.service...1051gitlab # [ 9.825926] gitlab-postgresql-start[1374]: CREATE DATABASE1052gitlab # [ 9.873672] gitlab-postgresql-start[1379]: CREATE EXTENSION1053gitlab # [ 9.911561] gitlab-postgresql-start[1393]: CREATE EXTENSION1054gitlab # [ 9.914484] systemd[1]: Finished gitlab-postgresql.service.1055gitlab # [ 10.206616] gitaly[1356]: time="2026-07-25T09:38:23.069Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/2wcq0nlg508fs5wq7jnpg1lw2pib950g-gitaly.toml' and fix the errors that are printed." pid=13561056gitlab # [ 10.207403] gitaly[1356]: time="2026-07-25T09:38:23.069Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=13561057gitlab # [ 10.208264] gitaly[1356]: time="2026-07-25T09:38:23.069Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=13561058gitlab # [ 10.208974] gitaly[1356]: time="2026-07-25T09:38:23.069Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=13561059gitlab # [ 10.209660] gitaly[1356]: time="2026-07-25T09:38:23.069Z" level=info msg="Starting Gitaly" pid=1356 version=18.11.41060gitlab # [ 10.407258] gitaly[1356]: time="2026-07-25T09:38:23.270Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=191 pid=13561061gitlab # [ 10.407857] gitaly[1356]: time="2026-07-25T09:38:23.271Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=13561062gitlab # [ 10.410553] gitaly[1356]: time="2026-07-25T09:38:23.274Z" level=info msg="finished initializing command factory" duration_ms=3 pid=13561063gitlab # [ 10.410968] gitaly[1356]: time="2026-07-25T09:38:23.274Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1356/git-exec-3649669305.d/git pid=13561064gitlab # [ 10.417711] gitaly[1356]: time="2026-07-25T09:38:23.281Z" level=info msg="finished detecting git version" duration_ms=7 pid=13561065gitlab # [ 10.418153] gitaly[1356]: time="2026-07-25T09:38:23.281Z" level=info msg="using Git version" pid=1356 version=2.53.g1066gitlab # [ 10.420837] gitaly[1356]: time="2026-07-25T09:38:23.284Z" level=info msg="clearing disk cache object folder" pid=1356 storage=default1067gitlab # [ 10.421118] gitaly[1356]: time="2026-07-25T09:38:23.284Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1075697154 pid=1356 storage=default1068gitlab # [ 10.421660] gitaly[1356]: time="2026-07-25T09:38:23.284Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1075697154 pid=1356 storage=default1069gitlab # [ 10.422221] gitaly[1356]: time="2026-07-25T09:38:23.284Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=13561070gitlab # [ 10.422661] gitaly[1356]: time="2026-07-25T09:38:23.284Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=13561071gitlab # [ 10.423176] gitaly[1356]: time="2026-07-25T09:38:23.285Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1075697154 clear_duration_ms=0 pid=1356 storage=default1072gitlab # [ 10.455264] gitaly[1356]: time="2026-07-25T09:38:23.318Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=13561073gitlab # [ 10.455608] gitaly[1356]: time="2026-07-25T09:38:23.318Z" level=info msg="counting repositories" pid=13561074gitlab # [ 10.456149] gitaly[1356]: time="2026-07-25T09:38:23.319Z" level=info msg="starting to count repositories" pid=1356 storage_path=/var/gitlab/state/repositories1075gitlab # [ 10.456706] gitaly[1356]: time="2026-07-25T09:38:23.319Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=1356 storage_path=/var/gitlab/state/repositories1076gitlab # [ 10.457714] gitaly[1356]: time="2026-07-25T09:38:23.319Z" level=info msg="completed counting all repositories" counting_duration=0 pid=13561077gitlab # [ 10.458175] gitaly[1356]: time="2026-07-25T09:38:23.318Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1356 schema=unix1078gitlab # [ 10.458645] gitaly[1356]: time="2026-07-25T09:38:23.319Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1356/sock.d/intern pid=1356 schema=unix1079gitlab # [ 10.459229] gitaly[1356]: time="2026-07-25T09:38:23.319Z" level=info msg="finished tempdir cleaner walk" pid=1356 storage=default time_ms=01080gitlab # [ 10.459647] gitaly[1356]: time="2026-07-25T09:38:23.320Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=13561081gitlab # [ 10.460168] gitaly[1356]: time="2026-07-25T09:38:23.320Z" level=info msg="Started Gitaly" duration_ms=250 pid=13561082gitlab # [ 10.460624] gitaly[1356]: time="2026-07-25T09:38:23.321Z" level=info msg="maintenance: daily scheduled" pid=1356 scheduled="2026-07-25 12:00:00 +0000 UTC"1083gitlab # [ 11.155144] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1369]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1084gitlab # [ 11.161835] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1369]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1085gitlab # [ 11.185855] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1369]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1086gitlab # [ 12.356502] gitaly[1356]: time="2026-07-25T09:38:25.219Z" level=info msg="License database preloaded" duration_ms=2149 pid=13561087gitlab # [ 14.602098] dhcpcd[1229]: eth0: leased 10.0.2.15 for 86400 seconds1088gitlab # [ 14.602809] dhcpcd[1229]: eth0: adding route to 10.0.2.0/241089gitlab # [ 14.603646] dhcpcd[1229]: eth0: adding default route via 10.0.2.21090gitlab # [ 14.708197] systemd[1]: Started DHCP Client.1091gitlab # [ 14.709878] systemd[1]: Reached target Network is Online.1092gitlab # [ 40.050298] postgres[1729]: [1729] ERROR: relation "feature_gates" does not exist at character 5231093gitlab # [ 40.050830] postgres[1729]: [1729] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1094gitlab # [ 40.052957] postgres[1729]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1095gitlab # [ 40.054565] postgres[1729]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1096gitlab # [ 40.056180] postgres[1729]: attidentity AS identity,1097gitlab # [ 40.059494] postgres[1729]: attgenerated as attgenerated1098gitlab # [ 40.061534] postgres[1729]: FROM pg_attribute a1099gitlab # [ 40.063685] postgres[1729]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1100gitlab # [ 40.066140] postgres[1729]: LEFT JOIN pg_type t ON a.atttypid = t.oid1101gitlab # [ 40.067255] postgres[1729]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1102gitlab # [ 40.069146] postgres[1729]: WHERE a.attrelid = '"feature_gates"'::regclass1103gitlab # [ 40.071069] postgres[1729]: AND a.attnum > 0 AND NOT a.attisdropped1104gitlab # [ 40.072558] postgres[1729]: ORDER BY a.attnum1105gitlab # [ 40.074279] postgres[1729]:1106gitlab # [ 40.243091] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1369]: W, [2026-07-25T09:38:53.105986 #1369] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1107gitlab # [ 45.544267] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1785]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1108gitlab # [ 45.545163] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1785]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1109gitlab # [ 48.599080] gitlab-workhorse[1288]: time="2026-07-25T09:39:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1110gitlab # [ 58.600454] gitlab-workhorse[1288]: time="2026-07-25T09:39:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1111gitlab # [ 59.383418] postgres[1851]: [1851] ERROR: relation "table_without_models" does not exist1112gitlab # [ 59.384090] postgres[1851]: [1851] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1113gitlab # [ 68.610135] gitlab-workhorse[1288]: time="2026-07-25T09:39:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1114gitlab # [ 71.555378] systemd[1]: Finished gitlab-db-config.service.1115gitlab # [ 71.557693] systemd[1]: Started gitlab-sidekiq.service.1116gitlab # [ 71.559941] systemd[1]: Starting gitlab.service...1117gitlab # [ 71.891680] bundle[2018]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1118gitlab # [ 71.896489] bundle[2018]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1119gitlab # [ 71.900929] bundle[2018]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1120gitlab # [ 74.569884] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-07-25T09:39:27.416Z","message":"Starting cluster with 1 processes"}1121gitlab # [ 74.669109] bundle[2018]: {"timestamp":"2026-07-25T09:39:27.513Z","pid":2018,"message":"* Enabling systemd notification integration"}1122gitlab # [ 74.673145] bundle[2018]: {"timestamp":"2026-07-25T09:39:27.532Z","pid":2018,"message":"Puma starting in cluster mode..."}1123gitlab # [ 74.676655] bundle[2018]: {"timestamp":"2026-07-25T09:39:27.532Z","pid":2018,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1124gitlab # [ 74.680464] bundle[2018]: {"timestamp":"2026-07-25T09:39:27.532Z","pid":2018,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1125gitlab # [ 74.684762] bundle[2018]: {"timestamp":"2026-07-25T09:39:27.532Z","pid":2018,"message":"* Min threads: 0"}1126gitlab # [ 74.687776] bundle[2018]: {"timestamp":"2026-07-25T09:39:27.532Z","pid":2018,"message":"* Max threads: 4"}1127gitlab # [ 74.690798] bundle[2018]: {"timestamp":"2026-07-25T09:39:27.532Z","pid":2018,"message":"* Environment: production"}1128gitlab # [ 74.694120] bundle[2018]: {"timestamp":"2026-07-25T09:39:27.532Z","pid":2018,"message":"* Master PID: 2018"}1129gitlab # [ 74.697199] bundle[2018]: {"timestamp":"2026-07-25T09:39:27.532Z","pid":2018,"message":"* Workers: 2"}1130gitlab # [ 74.700202] bundle[2018]: {"timestamp":"2026-07-25T09:39:27.532Z","pid":2018,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1131gitlab # [ 74.703951] bundle[2018]: {"timestamp":"2026-07-25T09:39:27.532Z","pid":2018,"message":"* Preloading application"}1132gitlab # [ 78.610964] gitlab-workhorse[1288]: time="2026-07-25T09:39:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1133gitlab # [ 88.627808] gitlab-workhorse[1288]: time="2026-07-25T09:39:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1134gitlab # [ 96.857955] bundle[2018]: W, [2026-07-25T09:39:49.720743 #2018] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1135gitlab # [ 98.637899] gitlab-workhorse[1288]: time="2026-07-25T09:39:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1136gitlab # [ 99.814436] sidekiq-cluster[2048]: 2026-07-25T09:39:52.677Z pid=2048 tid=txk INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2048, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>427110400}1137gitlab # [ 99.987962] sidekiq-cluster[2048]: W, [2026-07-25T09:39:52.851344 #2048] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1138gitlab # [ 100.055201] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:52.918Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1139gitlab # [ 101.852891] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.715Z","message":"GitLab reliable fetch activated!"}1140gitlab # [ 101.853667] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.715Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1141gitlab # [ 101.881939] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.745Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1142gitlab # [ 101.886861] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.750Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1143gitlab # [ 101.891250] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.754Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1144gitlab # [ 101.895797] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.759Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1145gitlab # [ 101.900247] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.763Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1146gitlab # [ 101.904174] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.767Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1147gitlab # [ 101.907209] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.770Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1148gitlab # [ 101.910027] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.773Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1149gitlab # [ 101.912812] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.776Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1150gitlab # [ 101.915776] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.779Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1151gitlab # [ 101.917986] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.781Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1152gitlab # [ 101.920439] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.784Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1153gitlab # [ 101.922409] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.786Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1154gitlab # [ 101.924278] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.787Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1155gitlab # [ 101.926108] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.789Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1156gitlab # [ 101.927953] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.791Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1157gitlab # [ 101.929896] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.793Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1158gitlab # [ 101.932501] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.796Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1159gitlab # [ 101.934854] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.798Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1160gitlab # [ 101.937035] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.800Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1161gitlab # [ 101.939264] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.802Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1162gitlab # [ 101.941484] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.805Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1163gitlab # [ 101.943489] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.807Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1164gitlab # [ 101.945852] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.809Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1165gitlab # [ 101.947641] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.811Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1166gitlab # [ 101.949521] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.813Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1167gitlab # [ 101.951723] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.815Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1168gitlab # [ 101.954388] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.817Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1169gitlab # [ 101.957872] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.821Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1170gitlab # [ 101.960371] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.823Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1171gitlab # [ 101.967372] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.830Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1172gitlab # [ 101.970404] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.834Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1173gitlab # [ 101.974423] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.838Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1174gitlab # [ 101.979968] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.843Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1175gitlab # [ 101.985174] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.848Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1176gitlab # [ 101.987480] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.851Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1177gitlab # [ 101.989633] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.853Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1178gitlab # [ 101.992162] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.854Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1179gitlab # [ 101.994598] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.857Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1180gitlab # [ 101.997769] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.861Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1181gitlab # [ 102.002274] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.865Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1182gitlab # [ 102.006838] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.870Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1183gitlab # [ 102.011340] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.874Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1184gitlab # [ 102.015882] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.879Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1185gitlab # [ 102.020328] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.883Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1186gitlab # [ 102.025604] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.889Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1187gitlab # [ 102.030655] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.894Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1188gitlab # [ 102.035199] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.898Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1189gitlab # [ 102.039947] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.903Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1190gitlab # [ 102.045278] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.908Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1191gitlab # [ 102.051747] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.915Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1192gitlab # [ 102.056395] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.919Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1193gitlab # [ 102.061100] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.924Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1194gitlab # [ 102.079144] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.942Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1195gitlab # [ 102.082200] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.945Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1196gitlab # [ 102.084599] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.948Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1197gitlab # [ 102.088838] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.952Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1198gitlab # [ 102.091909] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.955Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1199gitlab # [ 102.095125] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.958Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1200gitlab # [ 102.097642] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.961Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1201gitlab # [ 102.100434] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.964Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1202gitlab # [ 102.103237] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.966Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1203gitlab # [ 102.105410] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.968Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1204gitlab # [ 102.107659] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.971Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1205gitlab # [ 102.112930] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.976Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1206gitlab # [ 102.117564] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.981Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1207gitlab # [ 102.120738] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.984Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1208gitlab # [ 102.123332] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.986Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1209gitlab # [ 102.125790] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.989Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1210gitlab # [ 102.128522] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.992Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1211gitlab # [ 102.131143] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:54.994Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1212gitlab # [ 102.153708] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.017Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1213gitlab # [ 102.156128] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.019Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1214gitlab # [ 102.159869] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.023Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1215gitlab # [ 102.163237] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.026Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1216gitlab # [ 102.168893] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.032Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1217gitlab # [ 102.175722] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.039Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1218gitlab # [ 102.180859] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.044Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1219gitlab # [ 102.187584] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.051Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1220gitlab # [ 102.192481] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.056Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1221gitlab # [ 102.198277] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.061Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1222gitlab # [ 102.203279] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.066Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1223gitlab # [ 102.209611] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.073Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1224gitlab # [ 102.216083] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.079Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1225gitlab # [ 102.222323] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.085Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1226gitlab # [ 102.227507] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.091Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1227gitlab # [ 102.233827] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.097Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1228gitlab # [ 102.239778] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.103Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1229gitlab # [ 102.245626] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.109Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1230gitlab # [ 102.250726] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.114Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1231gitlab # [ 102.256982] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.120Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1232gitlab # [ 102.262382] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.125Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1233gitlab # [ 102.267340] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.130Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1234gitlab # [ 102.273613] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.137Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1235gitlab # [ 102.278707] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.142Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1236gitlab # [ 102.285788] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.149Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1237gitlab # [ 102.291952] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.155Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1238gitlab # [ 102.298308] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.161Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1239gitlab # [ 102.303582] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.167Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1240gitlab # [ 102.321073] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.184Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1241gitlab # [ 102.327815] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.191Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1242gitlab # [ 102.331754] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.195Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1243gitlab # [ 102.337740] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.201Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1244gitlab # [ 102.342504] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.206Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1245gitlab # [ 102.347338] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.210Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1246gitlab # [ 102.352156] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.215Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1247gitlab # [ 102.356503] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.220Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1248gitlab # [ 102.360110] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.223Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1249gitlab # [ 102.365609] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.229Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1250gitlab # [ 102.369048] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:39:55.232Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1251gitlab # [ 108.647948] gitlab-workhorse[1288]: time="2026-07-25T09:40:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1252gitlab # [ 118.657789] gitlab-workhorse[1288]: time="2026-07-25T09:40:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1253gitlab # [ 122.834721] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:15.697Z","message":"Booted Rails 7.2.3 application in production environment"}1254gitlab # [ 122.839523] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:15.703Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1255gitlab # [ 122.840406] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:15.703Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1256gitlab # [ 122.841414] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:15.703Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1257gitlab # [ 122.853815] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:15.717Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1258gitlab # [ 123.437816] bundle[2018]: {"timestamp":"2026-07-25T09:40:16.300Z","pid":2018,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1259gitlab # [ 123.438225] bundle[2018]: {"timestamp":"2026-07-25T09:40:16.300Z","pid":2018,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1260gitlab # [ 123.439318] bundle[2018]: {"timestamp":"2026-07-25T09:40:16.300Z","pid":2018,"message":"! #\u003cThread:0x000070fa77b56ed0 /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1261gitlab # [ 123.440552] bundle[2018]: {"timestamp":"2026-07-25T09:40:16.300Z","pid":2018,"message":"! #\u003cThread:0x000070fa77da91d8 /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1262gitlab # [ 123.441996] bundle[2018]: {"timestamp":"2026-07-25T09:40:16.300Z","pid":2018,"message":"Use Ctrl-C to stop"}1263gitlab # [ 123.443167] bundle[2018]: {"timestamp":"2026-07-25T09:40:16.301Z","pid":2018,"message":"Sending status to systemd every 1.0 sec"}1264gitlab # [ 123.863152] bundle[2018]: {"timestamp":"2026-07-25T09:40:16.726Z","pid":2018,"message":"- Worker 0 (PID: 2522) booted in 0.36s, phase: 0"}1265gitlab # [ 123.866442] bundle[2018]: {"timestamp":"2026-07-25T09:40:16.729Z","pid":2018,"message":"- Worker 1 (PID: 2526) booted in 0.34s, phase: 0"}1266gitlab # [ 123.871707] systemd[1]: Started gitlab.service.1267gitlab # [ 123.873866] systemd[1]: Reached target Common target for all GitLab services..1268gitlab # [ 123.879465] systemd[1]: Starting setup-gitlab.service...1269gitlab # [ 123.900724] setup-gitlab-start[2559]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1270gitlab # [ 124.164316] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:17.027Z","message":"Cleaning working queues"}1271gitlab # [ 124.166708] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:17.029Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"10ec00f56956467442c853a7","created_at":"2026-07-25T09:39:23.851Z","trace_propagation_headers":{"sentry-trace":"dd0db9c8c5454779b71dd50bd83aefe8-67ef2eeb2abe4844","baggage":"sentry-trace_id=dd0db9c8c5454779b71dd50bd83aefe8,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"d266c94e763343fe90f29bfa367cbbbe","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-25T09:39:23.870Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-10ec00f56956467442c853a7: start","job_status":"start","queue_duration_s":53.159263,"scheduling_latency_s":53.159421}1272gitlab # [ 124.332264] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:17.195Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"10ec00f56956467442c853a7","created_at":"2026-07-25T09:39:23.851Z","trace_propagation_headers":{"sentry-trace":"dd0db9c8c5454779b71dd50bd83aefe8-67ef2eeb2abe4844","baggage":"sentry-trace_id=dd0db9c8c5454779b71dd50bd83aefe8,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"d266c94e763343fe90f29bfa367cbbbe","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-25T09:39:23.870Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-10ec00f56956467442c853a7: done: 0.165812 sec","job_status":"done","queue_duration_s":53.159263,"scheduling_latency_s":53.159421,"redis_calls":26,"redis_duration_s":0.007499,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.00358,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002417,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001502,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08393469,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.165812,"completed_at":"2026-07-25T09:40:17.195Z","load_balancing_strategy":"primary","db_duration_s":0.05898,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1273gitlab # [ 126.330852] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:40:19 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 24021274gitlab # [ 126.337918] setup-gitlab-start[2585]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1275gitlab # [ 126.338335] setup-gitlab-start[2586]: ++ jq -r .access_token1276gitlab # [ 127.071550] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:40:19 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 7121277gitlab # [ 127.078811] setup-gitlab-start[2559]: + BEARER=03253dc094ce5ea7bc9e4265b746b9c510b06afc1cda58ad6bf9ccb123a0565d1278gitlab # [ 127.082115] setup-gitlab-start[2559]: + AUTH='Authorization: Bearer 03253dc094ce5ea7bc9e4265b746b9c510b06afc1cda58ad6bf9ccb123a0565d'1279gitlab # [ 127.085780] setup-gitlab-start[2559]: + curl -fs -X PUT -H 'Authorization: Bearer 03253dc094ce5ea7bc9e4265b746b9c510b06afc1cda58ad6bf9ccb123a0565d' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1280gitlab # [ 128.330523] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:40:21 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 12341281gitlab # [ 128.333954] setup-gitlab-start[2559]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1282gitlab # [ 128.348624] runuser[2610]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1283gitlab # [ 128.710709] setup-gitlab-start[2611]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1284gitlab # [ 128.711441] setup-gitlab-start[2611]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1285gitlab # [ 128.712912] setup-gitlab-start[2611]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1286gitlab # [ 129.245852] setup-gitlab-start[2611]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1287gitlab # [ 129.246523] setup-gitlab-start[2611]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1288gitlab # [ 129.249591] setup-gitlab-start[2611]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1289gitlab # [ 135.317779] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.180Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"20abd3af00d3dedc4ad94993","created_at":"2026-07-25T09:40:28.145Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5564914b605589779a35053892f59e34","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.177Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-20abd3af00d3dedc4ad94993: start","job_status":"start","queue_duration_s":0.002408,"scheduling_latency_s":0.002443}1290gitlab # [ 135.375983] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"20abd3af00d3dedc4ad94993","created_at":"2026-07-25T09:40:28.145Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5564914b605589779a35053892f59e34","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.177Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-20abd3af00d3dedc4ad94993: done: 0.059049 sec","job_status":"done","queue_duration_s":0.002408,"scheduling_latency_s":0.002443,"redis_calls":12,"redis_duration_s":0.008723,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002138,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002324,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004261,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002007238,"exclusive_lock_hold_duration_s":0.005569422,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.059049,"completed_at":"2026-07-25T09:40:28.239Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 135.439504] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"693fa176899c48e6da5161a6","created_at":"2026-07-25T09:40:28.186Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6af3037b358616c8a5e601e439498c15","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.193Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-693fa176899c48e6da5161a6: start","job_status":"start","queue_duration_s":0.046818,"scheduling_latency_s":0.046832}1292gitlab # [ 135.452663] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.250Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1293gitlab # [ 135.456213] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.255Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"693fa176899c48e6da5161a6","created_at":"2026-07-25T09:40:28.186Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6af3037b358616c8a5e601e439498c15","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.193Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-693fa176899c48e6da5161a6: done: 0.01537 sec","job_status":"done","queue_duration_s":0.046818,"scheduling_latency_s":0.046832,"redis_calls":10,"redis_duration_s":0.003675,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000431,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000256178,"duration_s":0.01537,"completed_at":"2026-07-25T09:40:28.255Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001401,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 135.494301] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.258Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"73e0b41403c40a5ad3a6dcb3","created_at":"2026-07-25T09:40:28.201Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"633f718c3a9a3c11887cd0527de758be","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.213Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-73e0b41403c40a5ad3a6dcb3: start","job_status":"start","queue_duration_s":0.044739,"scheduling_latency_s":0.044752}1295gitlab # [ 135.507128] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.348Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"73e0b41403c40a5ad3a6dcb3","created_at":"2026-07-25T09:40:28.201Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"633f718c3a9a3c11887cd0527de758be","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.213Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-73e0b41403c40a5ad3a6dcb3: done: 0.090678 sec","job_status":"done","queue_duration_s":0.044739,"scheduling_latency_s":0.044752,"redis_calls":16,"redis_duration_s":0.013365,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.005543,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001628,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003597105,"duration_s":0.090678,"completed_at":"2026-07-25T09:40:28.348Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 135.528713] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.351Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"4834ba9f18ddb7c909e45840","created_at":"2026-07-25T09:40:28.225Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e74b1494ac517943426021a0b538be17","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.256Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-4834ba9f18ddb7c909e45840: start","job_status":"start","queue_duration_s":0.094589,"scheduling_latency_s":0.094605}1297gitlab # [ 135.566151] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.429Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"4834ba9f18ddb7c909e45840","created_at":"2026-07-25T09:40:28.225Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e74b1494ac517943426021a0b538be17","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.256Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-4834ba9f18ddb7c909e45840: done: 0.078308 sec","job_status":"done","queue_duration_s":0.094589,"scheduling_latency_s":0.094605,"redis_calls":10,"redis_duration_s":0.01405,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001829,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011164,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000656508,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.00176419},"duration_s":0.078308,"completed_at":"2026-07-25T09:40:28.429Z","load_balancing_strategy":"primary","db_duration_s":0.037557,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 135.586859] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.432Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a068c7bb039e8643c8fe0cb5","created_at":"2026-07-25T09:40:28.264Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23a22d6c73b99f8b3aec0892ba702250","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.274Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a068c7bb039e8643c8fe0cb5: start","job_status":"start","queue_duration_s":0.158313,"scheduling_latency_s":0.158337}1299gitlab # [ 135.925301] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.788Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a068c7bb039e8643c8fe0cb5","created_at":"2026-07-25T09:40:28.264Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23a22d6c73b99f8b3aec0892ba702250","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.274Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a068c7bb039e8643c8fe0cb5: done: 0.355368 sec","job_status":"done","queue_duration_s":0.158313,"scheduling_latency_s":0.158337,"redis_calls":12,"redis_duration_s":0.005773,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000805,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002892,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.167461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000438883,"exclusive_lock_hold_duration_s":0.324206009,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.355368,"completed_at":"2026-07-25T09:40:28.788Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 136.006287] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.869Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"53ea6cfdb55e394d23935508","created_at":"2026-07-25T09:40:28.302Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59da5452a280be33d29f32c360d3d0e7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.308Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-53ea6cfdb55e394d23935508: start","job_status":"start","queue_duration_s":0.561134,"scheduling_latency_s":0.561184}1301gitlab # [ 136.065903] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"53ea6cfdb55e394d23935508","created_at":"2026-07-25T09:40:28.302Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59da5452a280be33d29f32c360d3d0e7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.308Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-53ea6cfdb55e394d23935508: done: 0.059755 sec","job_status":"done","queue_duration_s":0.561134,"scheduling_latency_s":0.561184,"redis_calls":13,"redis_duration_s":0.0033569999999999997,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001851,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.016082491,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.059755,"completed_at":"2026-07-25T09:40:28.928Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005853,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1302gitlab # [ 136.127189] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:28.988Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"fcc42dd28790ada4112d2986","created_at":"2026-07-25T09:40:28.321Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3ccafb81b33c438b2facdb5262b71a4","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.334Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-fcc42dd28790ada4112d2986: start","job_status":"start","queue_duration_s":0.65421,"scheduling_latency_s":0.654255}1303gitlab # [ 136.166079] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"fcc42dd28790ada4112d2986","created_at":"2026-07-25T09:40:28.321Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3ccafb81b33c438b2facdb5262b71a4","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.334Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-fcc42dd28790ada4112d2986: done: 0.040557 sec","job_status":"done","queue_duration_s":0.65421,"scheduling_latency_s":0.654255,"redis_calls":13,"redis_duration_s":0.004531,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000593,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00198,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001958,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000473803,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.040557,"completed_at":"2026-07-25T09:40:29.029Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 136.167902] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"3f367dbc18632f7cfe719a5c","created_at":"2026-07-25T09:40:28.343Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"321335ce8b933c99e1eafc11330bc4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.353Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-3f367dbc18632f7cfe719a5c: start","job_status":"start","queue_duration_s":0.677074,"scheduling_latency_s":0.677099}1305gitlab # [ 136.201329] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.064Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"3f367dbc18632f7cfe719a5c","created_at":"2026-07-25T09:40:28.343Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"321335ce8b933c99e1eafc11330bc4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.353Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-3f367dbc18632f7cfe719a5c: done: 0.033393 sec","job_status":"done","queue_duration_s":0.677074,"scheduling_latency_s":0.677099,"redis_calls":10,"redis_duration_s":0.00196,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000392,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001055,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000367365,"duration_s":0.033393,"completed_at":"2026-07-25T09:40:29.064Z","load_balancing_strategy":"primary","db_duration_s":0.004289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 136.253613] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"27c1b7bc8aa6a74e93ae60d0","created_at":"2026-07-25T09:40:28.364Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f9b6d42dcdf8cb29a33ba21556657d1","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.374Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-27c1b7bc8aa6a74e93ae60d0: start","job_status":"start","queue_duration_s":0.691681,"scheduling_latency_s":0.691707}1307gitlab # [ 136.254384] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.090Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"27c1b7bc8aa6a74e93ae60d0","created_at":"2026-07-25T09:40:28.364Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f9b6d42dcdf8cb29a33ba21556657d1","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.374Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-27c1b7bc8aa6a74e93ae60d0: done: 0.024048 sec","job_status":"done","queue_duration_s":0.691681,"scheduling_latency_s":0.691707,"redis_calls":10,"redis_duration_s":0.001563,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198908,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.024048,"completed_at":"2026-07-25T09:40:29.090Z","load_balancing_strategy":"primary","db_duration_s":0.008697,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 136.296874] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.091Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"9719a2e038e7ab08b6b93bfa","created_at":"2026-07-25T09:40:28.379Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11c7e6796bb07f354b05d0993c367a1c","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.387Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-9719a2e038e7ab08b6b93bfa: start","job_status":"start","queue_duration_s":0.703501,"scheduling_latency_s":0.703515}1309gitlab # [ 136.297690] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"9719a2e038e7ab08b6b93bfa","created_at":"2026-07-25T09:40:28.379Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11c7e6796bb07f354b05d0993c367a1c","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.387Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-9719a2e038e7ab08b6b93bfa: done: 0.014617 sec","job_status":"done","queue_duration_s":0.703501,"scheduling_latency_s":0.703515,"redis_calls":10,"redis_duration_s":0.00123,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000187454,"duration_s":0.014617,"completed_at":"2026-07-25T09:40:29.105Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001624,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 136.318585] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.106Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"f4ae07baed3df03e871a4dde","created_at":"2026-07-25T09:40:28.392Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1e774e4b77c61ac239e770b407c1f23","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.395Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-f4ae07baed3df03e871a4dde: start","job_status":"start","queue_duration_s":0.711767,"scheduling_latency_s":0.71178}1311gitlab # [ 136.330727] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.118Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"f4ae07baed3df03e871a4dde","created_at":"2026-07-25T09:40:28.392Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1e774e4b77c61ac239e770b407c1f23","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.395Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-f4ae07baed3df03e871a4dde: done: 0.011865 sec","job_status":"done","queue_duration_s":0.711767,"scheduling_latency_s":0.71178,"redis_calls":12,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000296,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000235,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000219022,"duration_s":0.011865,"completed_at":"2026-07-25T09:40:29.118Z","load_balancing_strategy":"primary","db_duration_s":0.000227,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 136.370082] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.119Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8d791b050315f8c1a6e0712c","created_at":"2026-07-25T09:40:28.427Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92a2f772081082d03ace1368a44eafbc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.432Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8d791b050315f8c1a6e0712c: start","job_status":"start","queue_duration_s":0.687613,"scheduling_latency_s":0.687651}1313gitlab # [ 136.418515] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.126Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1314gitlab # [ 136.419206] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.131Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8d791b050315f8c1a6e0712c","created_at":"2026-07-25T09:40:28.427Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92a2f772081082d03ace1368a44eafbc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.432Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8d791b050315f8c1a6e0712c: done: 0.011398 sec","job_status":"done","queue_duration_s":0.687613,"scheduling_latency_s":0.687651,"redis_calls":10,"redis_duration_s":0.001205,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000182425,"duration_s":0.011398,"completed_at":"2026-07-25T09:40:29.131Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 136.421054] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.131Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"51fac1794fe046cf4972da83","created_at":"2026-07-25T09:40:28.439Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d18ec38237a126417b97afb952460833","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.448Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-51fac1794fe046cf4972da83: start","job_status":"start","queue_duration_s":0.682994,"scheduling_latency_s":0.683008}1316gitlab # [ 136.433671] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.146Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"51fac1794fe046cf4972da83","created_at":"2026-07-25T09:40:28.439Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d18ec38237a126417b97afb952460833","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.448Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-51fac1794fe046cf4972da83: done: 0.014307 sec","job_status":"done","queue_duration_s":0.682994,"scheduling_latency_s":0.683008,"redis_calls":10,"redis_duration_s":0.001241,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000725,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000187454,"duration_s":0.014307,"completed_at":"2026-07-25T09:40:29.146Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 136.475607] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.147Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ebe54ee39b2ac5b66b56ea57","created_at":"2026-07-25T09:40:28.455Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4a862fb88176ba6708e455e6a026740","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.461Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ebe54ee39b2ac5b66b56ea57: start","job_status":"start","queue_duration_s":0.68529,"scheduling_latency_s":0.685302}1318gitlab # [ 136.483873] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.276Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ebe54ee39b2ac5b66b56ea57","created_at":"2026-07-25T09:40:28.455Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4a862fb88176ba6708e455e6a026740","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.461Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ebe54ee39b2ac5b66b56ea57: done: 0.129048 sec","job_status":"done","queue_duration_s":0.68529,"scheduling_latency_s":0.685302,"redis_calls":14,"redis_duration_s":0.0019979999999999998,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000477,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000785,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000736,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":125,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":80,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000315682,"exclusive_lock_hold_duration_s":0.11471485899999999,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.129048,"completed_at":"2026-07-25T09:40:29.276Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031711,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 136.532403] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.277Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"cc932e59f5159ecb6932010b","created_at":"2026-07-25T09:40:28.477Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddaa17f0a08815966b4ffea4ddea9420","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.481Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-cc932e59f5159ecb6932010b: start","job_status":"start","queue_duration_s":0.796159,"scheduling_latency_s":0.796173}1320gitlab # [ 136.572992] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"cc932e59f5159ecb6932010b","created_at":"2026-07-25T09:40:28.477Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddaa17f0a08815966b4ffea4ddea9420","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.481Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-cc932e59f5159ecb6932010b: done: 0.019465 sec","job_status":"done","queue_duration_s":0.796159,"scheduling_latency_s":0.796173,"redis_calls":12,"redis_duration_s":0.001922,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000348,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000404521,"exclusive_lock_hold_duration_s":0.0043466419999999995,"duration_s":0.019465,"completed_at":"2026-07-25T09:40:29.296Z","load_balancing_strategy":"primary","db_duration_s":0.001829,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 136.574027] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.298Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"f60d34d2f47ff541ab2997c9","created_at":"2026-07-25T09:40:28.485Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4419d2767292ff6297639e40df548745","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.492Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-f60d34d2f47ff541ab2997c9: start","job_status":"start","queue_duration_s":0.805974,"scheduling_latency_s":0.805989}1322gitlab # [ 136.613889] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"f60d34d2f47ff541ab2997c9","created_at":"2026-07-25T09:40:28.485Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4419d2767292ff6297639e40df548745","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.492Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-f60d34d2f47ff541ab2997c9: done: 0.014968 sec","job_status":"done","queue_duration_s":0.805974,"scheduling_latency_s":0.805989,"redis_calls":12,"redis_duration_s":0.001667,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000651,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000289422,"exclusive_lock_hold_duration_s":0.002750071,"duration_s":0.014968,"completed_at":"2026-07-25T09:40:29.312Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001731,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 136.659924] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"1e9bbacc25153850b4038d17","created_at":"2026-07-25T09:40:28.498Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce56c36e9dc4941129f74be3b0f48e0d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-25T09:40:28.502Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-1e9bbacc25153850b4038d17: start","job_status":"start","queue_duration_s":0.811529,"scheduling_latency_s":0.811542}1324gitlab # [ 136.660683] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.320Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1325gitlab # [ 136.661152] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.325Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"1e9bbacc25153850b4038d17","created_at":"2026-07-25T09:40:28.498Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce56c36e9dc4941129f74be3b0f48e0d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-25T09:40:28.502Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-1e9bbacc25153850b4038d17: done: 0.011401 sec","job_status":"done","queue_duration_s":0.811529,"scheduling_latency_s":0.811542,"redis_calls":10,"redis_duration_s":0.001201,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000182704,"duration_s":0.011401,"completed_at":"2026-07-25T09:40:29.325Z","load_balancing_strategy":"primary","db_duration_s":0.000237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 136.718738] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.326Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"3e6840c3d41d08eea9a19ef0","created_at":"2026-07-25T09:40:28.505Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a95ad5ddbe65a7051c990094759884a3","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.508Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-3e6840c3d41d08eea9a19ef0: start","job_status":"start","queue_duration_s":0.817266,"scheduling_latency_s":0.817279}1327gitlab # [ 136.719563] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.340Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"3e6840c3d41d08eea9a19ef0","created_at":"2026-07-25T09:40:28.505Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a95ad5ddbe65a7051c990094759884a3","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.508Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-3e6840c3d41d08eea9a19ef0: done: 0.014274 sec","job_status":"done","queue_duration_s":0.817266,"scheduling_latency_s":0.817279,"redis_calls":10,"redis_duration_s":0.001228,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000190527,"duration_s":0.014274,"completed_at":"2026-07-25T09:40:29.340Z","load_balancing_strategy":"primary","db_duration_s":0.00023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 136.764164] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.341Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"25649c5f99d446f4a829dc21","created_at":"2026-07-25T09:40:28.511Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51ef133157428ea35589db9a30235848","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.514Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-25649c5f99d446f4a829dc21: start","job_status":"start","queue_duration_s":0.826961,"scheduling_latency_s":0.826975}1329gitlab # [ 136.764976] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.358Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"25649c5f99d446f4a829dc21","created_at":"2026-07-25T09:40:28.511Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51ef133157428ea35589db9a30235848","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.514Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-25649c5f99d446f4a829dc21: done: 0.017553 sec","job_status":"done","queue_duration_s":0.826961,"scheduling_latency_s":0.826975,"redis_calls":11,"redis_duration_s":0.001594,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.0003,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191085,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.017553,"completed_at":"2026-07-25T09:40:29.358Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004267,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 136.815094] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.359Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"9785b2c4b0ac87747cacfd44","created_at":"2026-07-25T09:40:28.520Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a86b44b489a5ed38fb3927eaa9fda67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-25T09:40:28.527Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-9785b2c4b0ac87747cacfd44: start","job_status":"start","queue_duration_s":0.832661,"scheduling_latency_s":0.832674}1331gitlab # [ 136.815787] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.366Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1332gitlab # [ 136.816449] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.371Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"9785b2c4b0ac87747cacfd44","created_at":"2026-07-25T09:40:28.520Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a86b44b489a5ed38fb3927eaa9fda67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-25T09:40:28.527Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-9785b2c4b0ac87747cacfd44: done: 0.011952 sec","job_status":"done","queue_duration_s":0.832661,"scheduling_latency_s":0.832674,"redis_calls":10,"redis_duration_s":0.001262,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000288,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203098,"duration_s":0.011952,"completed_at":"2026-07-25T09:40:29.371Z","load_balancing_strategy":"primary","db_duration_s":0.000232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 136.858743] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.372Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"862da11db191452fe219c144","created_at":"2026-07-25T09:40:28.539Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac438306a14e7399f6205ac89d4d1638","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.542Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-862da11db191452fe219c144: start","job_status":"start","queue_duration_s":0.8298,"scheduling_latency_s":0.829813}1334gitlab # [ 136.859659] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.406Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"862da11db191452fe219c144","created_at":"2026-07-25T09:40:28.539Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac438306a14e7399f6205ac89d4d1638","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.542Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-862da11db191452fe219c144: done: 0.033534 sec","job_status":"done","queue_duration_s":0.8298,"scheduling_latency_s":0.829813,"redis_calls":14,"redis_duration_s":0.001957,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000685,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000353676,"exclusive_lock_hold_duration_s":0.016375546,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.033534,"completed_at":"2026-07-25T09:40:29.406Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 136.906065] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.407Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7b622cdce091c931d4a1803d","created_at":"2026-07-25T09:40:28.546Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61be7b50aafd182d9bf12ba994b86fff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.549Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7b622cdce091c931d4a1803d: start","job_status":"start","queue_duration_s":0.857951,"scheduling_latency_s":0.857964}1336gitlab # [ 136.906777] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.420Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7b622cdce091c931d4a1803d","created_at":"2026-07-25T09:40:28.546Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61be7b50aafd182d9bf12ba994b86fff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.549Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7b622cdce091c931d4a1803d: done: 0.013332 sec","job_status":"done","queue_duration_s":0.857951,"scheduling_latency_s":0.857964,"redis_calls":12,"redis_duration_s":0.001508,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000487,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000186616,"duration_s":0.013332,"completed_at":"2026-07-25T09:40:29.420Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000449,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 136.946192] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.421Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7b71fea0919b55b708df50bc","created_at":"2026-07-25T09:40:28.551Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"720b413108d5f13511655a6323e559cb","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.554Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7b71fea0919b55b708df50bc: start","job_status":"start","queue_duration_s":0.867034,"scheduling_latency_s":0.867047}1338gitlab # [ 136.951256] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.636Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7b71fea0919b55b708df50bc","created_at":"2026-07-25T09:40:28.551Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"720b413108d5f13511655a6323e559cb","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.554Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7b71fea0919b55b708df50bc: done: 0.215441 sec","job_status":"done","queue_duration_s":0.867034,"scheduling_latency_s":0.867047,"redis_calls":574,"redis_duration_s":0.062131,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.061152,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.176343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210921,"duration_s":0.215441,"completed_at":"2026-07-25T09:40:29.636Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000211,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 136.993028] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"afbf19dfea41441126a7b86f","created_at":"2026-07-25T09:40:28.558Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f2fdeb4618e22b1eaa3396e2d15bd55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.561Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-afbf19dfea41441126a7b86f: start","job_status":"start","queue_duration_s":1.076119,"scheduling_latency_s":1.076133}1340gitlab # [ 137.001298] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.653Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"afbf19dfea41441126a7b86f","created_at":"2026-07-25T09:40:28.558Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f2fdeb4618e22b1eaa3396e2d15bd55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.561Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-afbf19dfea41441126a7b86f: done: 0.015443 sec","job_status":"done","queue_duration_s":1.076119,"scheduling_latency_s":1.076133,"redis_calls":10,"redis_duration_s":0.001514,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000248356,"duration_s":0.015443,"completed_at":"2026-07-25T09:40:29.653Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000452,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 137.048718] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1cfc2c4e60be076690fe8608","created_at":"2026-07-25T09:40:28.572Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"acc5d740664947331c59f7961507103a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.582Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1cfc2c4e60be076690fe8608: start","job_status":"start","queue_duration_s":1.071386,"scheduling_latency_s":1.0714}1342gitlab # [ 137.051701] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.661Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1343gitlab # [ 137.090815] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.666Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1cfc2c4e60be076690fe8608","created_at":"2026-07-25T09:40:28.572Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"acc5d740664947331c59f7961507103a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.582Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1cfc2c4e60be076690fe8608: done: 0.01181 sec","job_status":"done","queue_duration_s":1.071386,"scheduling_latency_s":1.0714,"redis_calls":10,"redis_duration_s":0.001185,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000186057,"duration_s":0.01181,"completed_at":"2026-07-25T09:40:29.666Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 137.092419] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.667Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"7f5ff90d527ba83cc1570cff","created_at":"2026-07-25T09:40:28.591Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"4b20493c74be38e41cf7e3dcf8ad8f75","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.596Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-7f5ff90d527ba83cc1570cff: start","job_status":"start","queue_duration_s":1.070256,"scheduling_latency_s":1.070269}1345gitlab # [ 137.139139] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.678Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"7f5ff90d527ba83cc1570cff","created_at":"2026-07-25T09:40:28.591Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"4b20493c74be38e41cf7e3dcf8ad8f75","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.596Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-7f5ff90d527ba83cc1570cff: done: 0.011288 sec","job_status":"done","queue_duration_s":1.070256,"scheduling_latency_s":1.070269,"redis_calls":10,"redis_duration_s":0.001255,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00031,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189409,"duration_s":0.011288,"completed_at":"2026-07-25T09:40:29.678Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000221,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 137.142270] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.679Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"a2ab6eb3cf60f76b25b23679","created_at":"2026-07-25T09:40:28.600Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15b915ab70ecfdd2814bc1b77debaa74","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.603Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-a2ab6eb3cf60f76b25b23679: start","job_status":"start","queue_duration_s":1.075537,"scheduling_latency_s":1.07555}1347gitlab # [ 137.187847] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"a2ab6eb3cf60f76b25b23679","created_at":"2026-07-25T09:40:28.600Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15b915ab70ecfdd2814bc1b77debaa74","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.603Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-a2ab6eb3cf60f76b25b23679: done: 0.020055 sec","job_status":"done","queue_duration_s":1.075537,"scheduling_latency_s":1.07555,"redis_calls":20,"redis_duration_s":0.002369,"redis_read_bytes":21,"redis_write_bytes":4316,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000757,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000324,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2021,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000219302,"duration_s":0.020055,"completed_at":"2026-07-25T09:40:29.699Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 137.193441] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"1a63cbf9df6f73340ab0bff0","created_at":"2026-07-25T09:40:28.606Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84bd0eb177d0c3421df327b82139c12f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.610Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-1a63cbf9df6f73340ab0bff0: start","job_status":"start","queue_duration_s":1.090091,"scheduling_latency_s":1.090104}1349gitlab # [ 137.236956] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"1a63cbf9df6f73340ab0bff0","created_at":"2026-07-25T09:40:28.606Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84bd0eb177d0c3421df327b82139c12f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.610Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-1a63cbf9df6f73340ab0bff0: done: 0.020317 sec","job_status":"done","queue_duration_s":1.090091,"scheduling_latency_s":1.090104,"redis_calls":19,"redis_duration_s":0.0023279999999999998,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000479,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000181,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.0013,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000368,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00018466,"duration_s":0.020317,"completed_at":"2026-07-25T09:40:29.720Z","load_balancing_strategy":"primary","db_duration_s":0.001136,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 137.244851] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"74147dc4151057eb0ac824ec","created_at":"2026-07-25T09:40:28.614Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.618Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-74147dc4151057eb0ac824ec: start","job_status":"start","queue_duration_s":1.103093,"scheduling_latency_s":1.103106}1351gitlab # [ 137.289979] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.785Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"74147dc4151057eb0ac824ec","created_at":"2026-07-25T09:40:28.614Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.618Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-74147dc4151057eb0ac824ec: done: 0.063504 sec","job_status":"done","queue_duration_s":1.103093,"scheduling_latency_s":1.103106,"redis_calls":71,"redis_duration_s":0.009034,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001259,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000536,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.006858,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000381,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196673,"duration_s":0.063504,"completed_at":"2026-07-25T09:40:29.785Z","load_balancing_strategy":"primary","db_duration_s":0.003042,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 137.296124] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.786Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"57e034b564ddc40a7056cbd2","created_at":"2026-07-25T09:40:28.627Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf43fa52c6cfc6d7a345530ccfa63351","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.631Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-57e034b564ddc40a7056cbd2: start","job_status":"start","queue_duration_s":1.155083,"scheduling_latency_s":1.155097}1353gitlab # [ 137.341987] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"57e034b564ddc40a7056cbd2","created_at":"2026-07-25T09:40:28.627Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf43fa52c6cfc6d7a345530ccfa63351","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.631Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-57e034b564ddc40a7056cbd2: done: 0.013034 sec","job_status":"done","queue_duration_s":1.155083,"scheduling_latency_s":1.155097,"redis_calls":10,"redis_duration_s":0.001182,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000243,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000179074,"duration_s":0.013034,"completed_at":"2026-07-25T09:40:29.799Z","load_balancing_strategy":"primary","db_duration_s":0.000937,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 137.342963] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"253fe4a2457d7c8c8a3af960","created_at":"2026-07-25T09:40:28.634Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3be2c91f651cb76dafeaf74ca28699e6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.638Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-253fe4a2457d7c8c8a3af960: start","job_status":"start","queue_duration_s":1.161349,"scheduling_latency_s":1.161363}1355gitlab # [ 137.381906] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.806Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1356gitlab # [ 137.382649] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"253fe4a2457d7c8c8a3af960","created_at":"2026-07-25T09:40:28.634Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3be2c91f651cb76dafeaf74ca28699e6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.638Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-253fe4a2457d7c8c8a3af960: done: 0.011268 sec","job_status":"done","queue_duration_s":1.161349,"scheduling_latency_s":1.161363,"redis_calls":10,"redis_duration_s":0.001154,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000682,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000183264,"duration_s":0.011268,"completed_at":"2026-07-25T09:40:29.811Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000219,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 137.427820] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.812Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a7738dfe918e8ff64510d704","created_at":"2026-07-25T09:40:28.642Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd5179a5d664fc235bcfd640f0695bfb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-25T09:40:28.645Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a7738dfe918e8ff64510d704: start","job_status":"start","queue_duration_s":1.166367,"scheduling_latency_s":1.16638}1358gitlab # [ 137.428742] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.832Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a7738dfe918e8ff64510d704","created_at":"2026-07-25T09:40:28.642Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd5179a5d664fc235bcfd640f0695bfb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-25T09:40:28.645Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a7738dfe918e8ff64510d704: done: 0.019787 sec","job_status":"done","queue_duration_s":1.166367,"scheduling_latency_s":1.16638,"redis_calls":10,"redis_duration_s":0.001318,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000219581,"duration_s":0.019787,"completed_at":"2026-07-25T09:40:29.831Z","load_balancing_strategy":"primary","db_duration_s":0.002681,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 137.475959] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.832Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"1f4ff51823898f584501a42b","created_at":"2026-07-25T09:40:28.651Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d20d4daf8fc0f03f79ba804a3ee624ad","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.655Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-1f4ff51823898f584501a42b: start","job_status":"start","queue_duration_s":1.177645,"scheduling_latency_s":1.177658}1360gitlab # [ 137.476716] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.846Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"1f4ff51823898f584501a42b","created_at":"2026-07-25T09:40:28.651Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d20d4daf8fc0f03f79ba804a3ee624ad","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:28.655Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-1f4ff51823898f584501a42b: done: 0.013406 sec","job_status":"done","queue_duration_s":1.177645,"scheduling_latency_s":1.177658,"redis_calls":10,"redis_duration_s":0.001198,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000723,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000185498,"duration_s":0.013406,"completed_at":"2026-07-25T09:40:29.846Z","load_balancing_strategy":"primary","db_duration_s":0.000228,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 137.522674] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.847Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"e91ced1f990aa4233984e98e","created_at":"2026-07-25T09:40:29.686Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-b1848dc19c3c45ac","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"15b915ab70ecfdd2814bc1b77debaa74","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.691Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-e91ced1f990aa4233984e98e: start","job_status":"start","queue_duration_s":0.155637,"scheduling_latency_s":0.15565}1362gitlab # [ 137.523575] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.868Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"e91ced1f990aa4233984e98e","created_at":"2026-07-25T09:40:29.686Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-b1848dc19c3c45ac","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"15b915ab70ecfdd2814bc1b77debaa74","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.691Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-e91ced1f990aa4233984e98e: done: 0.021412 sec","job_status":"done","queue_duration_s":0.155637,"scheduling_latency_s":0.15565,"redis_calls":10,"redis_duration_s":0.001514,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225447,"duration_s":0.021412,"completed_at":"2026-07-25T09:40:29.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005747,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 137.542204] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.869Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"ad56681c7cb52594f3753b8e","created_at":"2026-07-25T09:40:29.691Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-b1848dc19c3c45ac","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"15b915ab70ecfdd2814bc1b77debaa74","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.694Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-ad56681c7cb52594f3753b8e: start","job_status":"start","queue_duration_s":0.175641,"scheduling_latency_s":0.175662}1364gitlab # [ 137.589334] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.884Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"ad56681c7cb52594f3753b8e","created_at":"2026-07-25T09:40:29.691Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-b1848dc19c3c45ac","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"15b915ab70ecfdd2814bc1b77debaa74","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.694Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-ad56681c7cb52594f3753b8e: done: 0.015168 sec","job_status":"done","queue_duration_s":0.175641,"scheduling_latency_s":0.175662,"redis_calls":10,"redis_duration_s":0.001317,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000281,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019835,"duration_s":0.015168,"completed_at":"2026-07-25T09:40:29.884Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000737,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 137.592659] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.885Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fd1c6ed0384b478f47e8cd9e","created_at":"2026-07-25T09:40:29.708Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-f0ae04f3fdf64b7b","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"84bd0eb177d0c3421df327b82139c12f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.715Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fd1c6ed0384b478f47e8cd9e: start","job_status":"start","queue_duration_s":0.170287,"scheduling_latency_s":0.1703}1366gitlab # [ 137.603732] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.895Z","message":"No existing merge request to be cleaned up."}1367gitlab # [ 137.605278] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.903Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fd1c6ed0384b478f47e8cd9e","created_at":"2026-07-25T09:40:29.708Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-f0ae04f3fdf64b7b","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"84bd0eb177d0c3421df327b82139c12f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.715Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fd1c6ed0384b478f47e8cd9e: done: 0.017272 sec","job_status":"done","queue_duration_s":0.170287,"scheduling_latency_s":0.1703,"redis_calls":13,"redis_duration_s":0.001977,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000244,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00063,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189689,"duration_s":0.017272,"completed_at":"2026-07-25T09:40:29.903Z","load_balancing_strategy":"primary","db_duration_s":0.002182,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 137.652178] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.904Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"25049c5ca8190dc9833f5838","created_at":"2026-07-25T09:40:29.708Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-f0ae04f3fdf64b7b","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"84bd0eb177d0c3421df327b82139c12f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.715Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-25049c5ca8190dc9833f5838: start","job_status":"start","queue_duration_s":0.188405,"scheduling_latency_s":0.188417}1369gitlab # [ 137.652880] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.910Z","message":"No existing merge request to be cleaned up."}1370gitlab # [ 137.653550] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.917Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"25049c5ca8190dc9833f5838","created_at":"2026-07-25T09:40:29.708Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-f0ae04f3fdf64b7b","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"84bd0eb177d0c3421df327b82139c12f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.715Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-25049c5ca8190dc9833f5838: done: 0.013696 sec","job_status":"done","queue_duration_s":0.188405,"scheduling_latency_s":0.188417,"redis_calls":10,"redis_duration_s":0.004349,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000847,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013696,"completed_at":"2026-07-25T09:40:29.917Z","load_balancing_strategy":"primary","db_duration_s":0.000902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 137.696094] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.918Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bc09f0c835695869e4ea80e6","created_at":"2026-07-25T09:40:29.708Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-f0ae04f3fdf64b7b","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"84bd0eb177d0c3421df327b82139c12f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.715Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bc09f0c835695869e4ea80e6: start","job_status":"start","queue_duration_s":0.202926,"scheduling_latency_s":0.202939}1372gitlab # [ 137.696671] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.924Z","message":"No existing merge request to be cleaned up."}1373gitlab # [ 137.697996] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.928Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bc09f0c835695869e4ea80e6","created_at":"2026-07-25T09:40:29.708Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-f0ae04f3fdf64b7b","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"84bd0eb177d0c3421df327b82139c12f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.715Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bc09f0c835695869e4ea80e6: done: 0.010412 sec","job_status":"done","queue_duration_s":0.202926,"scheduling_latency_s":0.202939,"redis_calls":10,"redis_duration_s":0.001276,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00076,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010412,"completed_at":"2026-07-25T09:40:29.928Z","load_balancing_strategy":"primary","db_duration_s":0.000994,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 137.748810] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.929Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"663b127708b54da54858ee0f","created_at":"2026-07-25T09:40:29.708Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-f0ae04f3fdf64b7b","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"84bd0eb177d0c3421df327b82139c12f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.715Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-663b127708b54da54858ee0f: start","job_status":"start","queue_duration_s":0.214097,"scheduling_latency_s":0.21411}1375gitlab # [ 137.749666] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.935Z","message":"No existing merge request to be cleaned up."}1376gitlab # [ 137.750205] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.940Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"663b127708b54da54858ee0f","created_at":"2026-07-25T09:40:29.708Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-f0ae04f3fdf64b7b","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"84bd0eb177d0c3421df327b82139c12f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.715Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-663b127708b54da54858ee0f: done: 0.010358 sec","job_status":"done","queue_duration_s":0.214097,"scheduling_latency_s":0.21411,"redis_calls":10,"redis_duration_s":0.001214,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010358,"completed_at":"2026-07-25T09:40:29.940Z","load_balancing_strategy":"primary","db_duration_s":0.000906,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 137.796508] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abac9b3019dedb6fdeec6292","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abac9b3019dedb6fdeec6292: start","job_status":"start","queue_duration_s":0.162049,"scheduling_latency_s":0.162063}1378gitlab # [ 137.797238] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abac9b3019dedb6fdeec6292","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abac9b3019dedb6fdeec6292: done: 0.013645 sec","job_status":"done","queue_duration_s":0.162049,"scheduling_latency_s":0.162063,"redis_calls":16,"redis_duration_s":0.001901,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001075,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000187175,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013645,"completed_at":"2026-07-25T09:40:29.954Z","load_balancing_strategy":"primary","db_duration_s":0.000217,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 137.844783] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63acaa958774cfe23bcdc148","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63acaa958774cfe23bcdc148: start","job_status":"start","queue_duration_s":0.181223,"scheduling_latency_s":0.181237}1380gitlab # [ 137.845689] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63acaa958774cfe23bcdc148","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63acaa958774cfe23bcdc148: done: 0.010507 sec","job_status":"done","queue_duration_s":0.181223,"scheduling_latency_s":0.181237,"redis_calls":13,"redis_duration_s":0.0019089999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001316,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010507,"completed_at":"2026-07-25T09:40:29.970Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 137.884123] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1d8341f7b38c4a41b06ddd0","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1d8341f7b38c4a41b06ddd0: start","job_status":"start","queue_duration_s":0.192511,"scheduling_latency_s":0.192524}1382gitlab # [ 137.884782] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1d8341f7b38c4a41b06ddd0","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1d8341f7b38c4a41b06ddd0: done: 0.009177 sec","job_status":"done","queue_duration_s":0.192511,"scheduling_latency_s":0.192524,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009177,"completed_at":"2026-07-25T09:40:29.980Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 137.914733] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0083372114f8d8530be48bec","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0083372114f8d8530be48bec: start","job_status":"start","queue_duration_s":0.202519,"scheduling_latency_s":0.202531}1384gitlab # [ 137.960091] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0083372114f8d8530be48bec","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0083372114f8d8530be48bec: done: 0.009396 sec","job_status":"done","queue_duration_s":0.202519,"scheduling_latency_s":0.202531,"redis_calls":13,"redis_duration_s":0.001514,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009396,"completed_at":"2026-07-25T09:40:29.990Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 137.961104] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:29.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e09624ef1c6571ba276c9aef","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e09624ef1c6571ba276c9aef: start","job_status":"start","queue_duration_s":0.212838,"scheduling_latency_s":0.212851}1386gitlab # [ 138.001889] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e09624ef1c6571ba276c9aef","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e09624ef1c6571ba276c9aef: done: 0.009049 sec","job_status":"done","queue_duration_s":0.212838,"scheduling_latency_s":0.212851,"redis_calls":13,"redis_duration_s":0.001624,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001156,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009049,"completed_at":"2026-07-25T09:40:30.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 138.004533] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5ae4b536f6123b7bdb14a4f","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5ae4b536f6123b7bdb14a4f: start","job_status":"start","queue_duration_s":0.222683,"scheduling_latency_s":0.222695}1388gitlab # [ 138.048228] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5ae4b536f6123b7bdb14a4f","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5ae4b536f6123b7bdb14a4f: done: 0.016763 sec","job_status":"done","queue_duration_s":0.222683,"scheduling_latency_s":0.222695,"redis_calls":13,"redis_duration_s":0.005379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00158,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003799,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016763,"completed_at":"2026-07-25T09:40:30.018Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 138.049684] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05110386f9e87a41874e0e93","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05110386f9e87a41874e0e93: start","job_status":"start","queue_duration_s":0.240393,"scheduling_latency_s":0.240407}1390gitlab # [ 138.060791] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05110386f9e87a41874e0e93","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05110386f9e87a41874e0e93: done: 0.0092 sec","job_status":"done","queue_duration_s":0.240393,"scheduling_latency_s":0.240407,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0092,"completed_at":"2026-07-25T09:40:30.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 138.107105] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81ac877032f0e20bbd4bc7ab","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81ac877032f0e20bbd4bc7ab: start","job_status":"start","queue_duration_s":0.250573,"scheduling_latency_s":0.250587}1392gitlab # [ 138.107831] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81ac877032f0e20bbd4bc7ab","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81ac877032f0e20bbd4bc7ab: done: 0.043134 sec","job_status":"done","queue_duration_s":0.250573,"scheduling_latency_s":0.250587,"redis_calls":13,"redis_duration_s":0.0016519999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.043134,"completed_at":"2026-07-25T09:40:30.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 138.146533] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dcd6253f8c480a53ac73136","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dcd6253f8c480a53ac73136: start","job_status":"start","queue_duration_s":0.294724,"scheduling_latency_s":0.294737}1394gitlab # [ 138.185973] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dcd6253f8c480a53ac73136","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dcd6253f8c480a53ac73136: done: 0.009415 sec","job_status":"done","queue_duration_s":0.294724,"scheduling_latency_s":0.294737,"redis_calls":13,"redis_duration_s":0.001576,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009415,"completed_at":"2026-07-25T09:40:30.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 138.186957] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ceb010348a5bcd91c12c7c0","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ceb010348a5bcd91c12c7c0: start","job_status":"start","queue_duration_s":0.305103,"scheduling_latency_s":0.305116}1396gitlab # [ 138.224858] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ceb010348a5bcd91c12c7c0","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ceb010348a5bcd91c12c7c0: done: 0.009221 sec","job_status":"done","queue_duration_s":0.305103,"scheduling_latency_s":0.305116,"redis_calls":13,"redis_duration_s":0.0015019999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009221,"completed_at":"2026-07-25T09:40:30.093Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 138.229221] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e96554a641df4c02923e0195","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e96554a641df4c02923e0195: start","job_status":"start","queue_duration_s":0.315471,"scheduling_latency_s":0.315484}1398gitlab # [ 138.240411] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e96554a641df4c02923e0195","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e96554a641df4c02923e0195: done: 0.013248 sec","job_status":"done","queue_duration_s":0.315471,"scheduling_latency_s":0.315484,"redis_calls":13,"redis_duration_s":0.005405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004739,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013248,"completed_at":"2026-07-25T09:40:30.107Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 138.288233] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d65d45571cb79b2c7b4b06f","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d65d45571cb79b2c7b4b06f: start","job_status":"start","queue_duration_s":0.331527,"scheduling_latency_s":0.331541}1400gitlab # [ 138.288964] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d65d45571cb79b2c7b4b06f","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d65d45571cb79b2c7b4b06f: done: 0.011092 sec","job_status":"done","queue_duration_s":0.331527,"scheduling_latency_s":0.331541,"redis_calls":13,"redis_duration_s":0.001554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011092,"completed_at":"2026-07-25T09:40:30.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 138.320472] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cebc22efbd6aaa1d499f45a2","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cebc22efbd6aaa1d499f45a2: start","job_status":"start","queue_duration_s":0.343434,"scheduling_latency_s":0.343447}1402gitlab # [ 138.364120] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cebc22efbd6aaa1d499f45a2","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cebc22efbd6aaa1d499f45a2: done: 0.009555 sec","job_status":"done","queue_duration_s":0.343434,"scheduling_latency_s":0.343447,"redis_calls":13,"redis_duration_s":0.0017530000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009555,"completed_at":"2026-07-25T09:40:30.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 138.365584] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1ccb2b0414063f443d4c08c","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1ccb2b0414063f443d4c08c: start","job_status":"start","queue_duration_s":0.353777,"scheduling_latency_s":0.35379}1404gitlab # [ 138.376761] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1ccb2b0414063f443d4c08c","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1ccb2b0414063f443d4c08c: done: 0.009957 sec","job_status":"done","queue_duration_s":0.353777,"scheduling_latency_s":0.35379,"redis_calls":13,"redis_duration_s":0.0016489999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009957,"completed_at":"2026-07-25T09:40:30.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 138.412546] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc3e31a135907cc26afa3921","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc3e31a135907cc26afa3921: start","job_status":"start","queue_duration_s":0.364568,"scheduling_latency_s":0.364581}1406gitlab # [ 138.423585] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc3e31a135907cc26afa3921","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc3e31a135907cc26afa3921: done: 0.00932 sec","job_status":"done","queue_duration_s":0.364568,"scheduling_latency_s":0.364581,"redis_calls":13,"redis_duration_s":0.0015309999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00932,"completed_at":"2026-07-25T09:40:30.152Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 138.471120] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f54f7e70e12bde62fa599549","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f54f7e70e12bde62fa599549: start","job_status":"start","queue_duration_s":0.378561,"scheduling_latency_s":0.378575}1408gitlab # [ 138.472533] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f54f7e70e12bde62fa599549","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f54f7e70e12bde62fa599549: done: 0.013246 sec","job_status":"done","queue_duration_s":0.378561,"scheduling_latency_s":0.378575,"redis_calls":13,"redis_duration_s":0.002173,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001653,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013246,"completed_at":"2026-07-25T09:40:30.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 138.532844] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f0690f2773f74ad08397340","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f0690f2773f74ad08397340: start","job_status":"start","queue_duration_s":0.392768,"scheduling_latency_s":0.39278}1410gitlab # [ 138.533746] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f0690f2773f74ad08397340","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f0690f2773f74ad08397340: done: 0.009326 sec","job_status":"done","queue_duration_s":0.392768,"scheduling_latency_s":0.39278,"redis_calls":13,"redis_duration_s":0.00151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009326,"completed_at":"2026-07-25T09:40:30.180Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 138.579721] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8a5d7696cbff601303ae824","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8a5d7696cbff601303ae824: start","job_status":"start","queue_duration_s":0.403162,"scheduling_latency_s":0.403175}1412gitlab # [ 138.580497] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8a5d7696cbff601303ae824","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8a5d7696cbff601303ae824: done: 0.009276 sec","job_status":"done","queue_duration_s":0.403162,"scheduling_latency_s":0.403175,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009276,"completed_at":"2026-07-25T09:40:30.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 138.630869] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2308ab21b537bd4f06c028c","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2308ab21b537bd4f06c028c: start","job_status":"start","queue_duration_s":0.413367,"scheduling_latency_s":0.41338}1414gitlab # [ 138.631616] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2308ab21b537bd4f06c028c","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2308ab21b537bd4f06c028c: done: 0.009653 sec","job_status":"done","queue_duration_s":0.413367,"scheduling_latency_s":0.41338,"redis_calls":13,"redis_duration_s":0.001754,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009653,"completed_at":"2026-07-25T09:40:30.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 138.675845] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72e10c3afb0e83471af31b1d","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72e10c3afb0e83471af31b1d: start","job_status":"start","queue_duration_s":0.42398,"scheduling_latency_s":0.423993}1416gitlab # [ 138.676630] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72e10c3afb0e83471af31b1d","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72e10c3afb0e83471af31b1d: done: 0.011873 sec","job_status":"done","queue_duration_s":0.42398,"scheduling_latency_s":0.423993,"redis_calls":13,"redis_duration_s":0.0015600000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011873,"completed_at":"2026-07-25T09:40:30.214Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 138.688639] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24d7b77246b49c90b346d0e6","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24d7b77246b49c90b346d0e6: start","job_status":"start","queue_duration_s":0.436822,"scheduling_latency_s":0.436835}1418gitlab # [ 138.699748] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24d7b77246b49c90b346d0e6","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24d7b77246b49c90b346d0e6: done: 0.009401 sec","job_status":"done","queue_duration_s":0.436822,"scheduling_latency_s":0.436835,"redis_calls":13,"redis_duration_s":0.001489,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009401,"completed_at":"2026-07-25T09:40:30.225Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 138.747260] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be3a410f57eb757758798a8d","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be3a410f57eb757758798a8d: start","job_status":"start","queue_duration_s":0.447119,"scheduling_latency_s":0.447132}1420gitlab # [ 138.748064] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be3a410f57eb757758798a8d","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be3a410f57eb757758798a8d: done: 0.009148 sec","job_status":"done","queue_duration_s":0.447119,"scheduling_latency_s":0.447132,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009148,"completed_at":"2026-07-25T09:40:30.235Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 138.790148] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d91953b012b417cfedf0867a","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d91953b012b417cfedf0867a: start","job_status":"start","queue_duration_s":0.457137,"scheduling_latency_s":0.457149}1422gitlab # [ 138.790438] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d91953b012b417cfedf0867a","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d91953b012b417cfedf0867a: done: 0.013224 sec","job_status":"done","queue_duration_s":0.457137,"scheduling_latency_s":0.457149,"redis_calls":13,"redis_duration_s":0.00167,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013224,"completed_at":"2026-07-25T09:40:30.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 138.833149] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f973e56e03b632d2f918c88f","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f973e56e03b632d2f918c88f: start","job_status":"start","queue_duration_s":0.471293,"scheduling_latency_s":0.471306}1424gitlab # [ 138.834069] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f973e56e03b632d2f918c88f","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f973e56e03b632d2f918c88f: done: 0.009693 sec","job_status":"done","queue_duration_s":0.471293,"scheduling_latency_s":0.471306,"redis_calls":13,"redis_duration_s":0.001542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009693,"completed_at":"2026-07-25T09:40:30.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 138.869078] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3e43ccb90cf5adc9c9b4647","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3e43ccb90cf5adc9c9b4647: start","job_status":"start","queue_duration_s":0.48181,"scheduling_latency_s":0.481824}1426gitlab # [ 138.912882] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3e43ccb90cf5adc9c9b4647","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3e43ccb90cf5adc9c9b4647: done: 0.009419 sec","job_status":"done","queue_duration_s":0.48181,"scheduling_latency_s":0.481824,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009419,"completed_at":"2026-07-25T09:40:30.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 138.914084] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:30.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b850006a77ba5fc1f2813d45","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b850006a77ba5fc1f2813d45: start","job_status":"start","queue_duration_s":0.492048,"scheduling_latency_s":0.492062}1428gitlab # [ 139.102728] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2690407750 wd_nsec: 26904076341429gitlab # [ 138.976891] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:31.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b850006a77ba5fc1f2813d45","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b850006a77ba5fc1f2813d45: done: 1.569343 sec","job_status":"done","queue_duration_s":0.492048,"scheduling_latency_s":0.492062,"redis_calls":13,"redis_duration_s":0.002058,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":1.569343,"completed_at":"2026-07-25T09:40:31.840Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 139.012341] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:31.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3578d764383d1be003e4865d","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3578d764383d1be003e4865d: start","job_status":"start","queue_duration_s":2.09692,"scheduling_latency_s":2.096953}1431gitlab # [ 139.022842] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:31.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3578d764383d1be003e4865d","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3578d764383d1be003e4865d: done: 0.010621 sec","job_status":"done","queue_duration_s":2.09692,"scheduling_latency_s":2.096953,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010621,"completed_at":"2026-07-25T09:40:31.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 139.058695] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:31.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50a781fa455933333b197680","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50a781fa455933333b197680: start","job_status":"start","queue_duration_s":2.143331,"scheduling_latency_s":2.14335}1433gitlab # [ 139.078686] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:31.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50a781fa455933333b197680","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50a781fa455933333b197680: done: 0.019992 sec","job_status":"done","queue_duration_s":2.143331,"scheduling_latency_s":2.14335,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019992,"completed_at":"2026-07-25T09:40:31.942Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 139.113708] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:31.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e380828bfc538215580ac2c","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e380828bfc538215580ac2c: start","job_status":"start","queue_duration_s":2.198293,"scheduling_latency_s":2.198315}1435gitlab # [ 139.143364] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e380828bfc538215580ac2c","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e380828bfc538215580ac2c: done: 0.029137 sec","job_status":"done","queue_duration_s":2.198293,"scheduling_latency_s":2.198315,"redis_calls":13,"redis_duration_s":0.002339,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001566,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029137,"completed_at":"2026-07-25T09:40:32.006Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 139.180735] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27b43e9dd3805b098644e667","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27b43e9dd3805b098644e667: start","job_status":"start","queue_duration_s":2.264996,"scheduling_latency_s":2.265044}1437gitlab # [ 139.205451] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27b43e9dd3805b098644e667","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27b43e9dd3805b098644e667: done: 0.024573 sec","job_status":"done","queue_duration_s":2.264996,"scheduling_latency_s":2.265044,"redis_calls":13,"redis_duration_s":0.0038840000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001231,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002653,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024573,"completed_at":"2026-07-25T09:40:32.068Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 139.241898] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74ca04cd41ac5010989cfaf3","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74ca04cd41ac5010989cfaf3: start","job_status":"start","queue_duration_s":2.326133,"scheduling_latency_s":2.326189}1439gitlab # [ 139.273589] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74ca04cd41ac5010989cfaf3","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74ca04cd41ac5010989cfaf3: done: 0.031363 sec","job_status":"done","queue_duration_s":2.326133,"scheduling_latency_s":2.326189,"redis_calls":13,"redis_duration_s":0.0027619999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001731,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031363,"completed_at":"2026-07-25T09:40:32.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 139.312181] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31cdc590238e68412e8107b5","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31cdc590238e68412e8107b5: start","job_status":"start","queue_duration_s":2.396493,"scheduling_latency_s":2.396534}1441gitlab # [ 139.336075] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31cdc590238e68412e8107b5","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31cdc590238e68412e8107b5: done: 0.023718 sec","job_status":"done","queue_duration_s":2.396493,"scheduling_latency_s":2.396534,"redis_calls":13,"redis_duration_s":0.003757,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001361,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002396,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023718,"completed_at":"2026-07-25T09:40:32.198Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 139.372670] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b572311df676ab7ed69e0cb","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b572311df676ab7ed69e0cb: start","job_status":"start","queue_duration_s":2.456364,"scheduling_latency_s":2.456405}1443gitlab # [ 139.397128] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b572311df676ab7ed69e0cb","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b572311df676ab7ed69e0cb: done: 0.025112 sec","job_status":"done","queue_duration_s":2.456364,"scheduling_latency_s":2.456405,"redis_calls":13,"redis_duration_s":0.004124,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001275,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002849,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025112,"completed_at":"2026-07-25T09:40:32.260Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 139.432751] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6765d07fa2f262d0e7658e2","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6765d07fa2f262d0e7658e2: start","job_status":"start","queue_duration_s":2.517293,"scheduling_latency_s":2.517319}1445gitlab # [ 139.463612] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6765d07fa2f262d0e7658e2","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6765d07fa2f262d0e7658e2: done: 0.030321 sec","job_status":"done","queue_duration_s":2.517293,"scheduling_latency_s":2.517319,"redis_calls":13,"redis_duration_s":0.0035779999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002456,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030321,"completed_at":"2026-07-25T09:40:32.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 139.465673] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb95449c260d816cb9c9ba8c","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb95449c260d816cb9c9ba8c: start","job_status":"start","queue_duration_s":2.550132,"scheduling_latency_s":2.55017}1447gitlab # [ 139.486384] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb95449c260d816cb9c9ba8c","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb95449c260d816cb9c9ba8c: done: 0.019796 sec","job_status":"done","queue_duration_s":2.550132,"scheduling_latency_s":2.55017,"redis_calls":13,"redis_duration_s":0.003346,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001011,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002335,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019796,"completed_at":"2026-07-25T09:40:32.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 139.538258] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40e3907b7de3d2a903aab0bf","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40e3907b7de3d2a903aab0bf: start","job_status":"start","queue_duration_s":2.577315,"scheduling_latency_s":2.577342}1449gitlab # [ 139.560658] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40e3907b7de3d2a903aab0bf","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40e3907b7de3d2a903aab0bf: done: 0.067915 sec","job_status":"done","queue_duration_s":2.577315,"scheduling_latency_s":2.577342,"redis_calls":13,"redis_duration_s":0.003352,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002257,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.067915,"completed_at":"2026-07-25T09:40:32.424Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 139.561914] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56b61534f48873fd7b61d890","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56b61534f48873fd7b61d890: start","job_status":"start","queue_duration_s":2.646305,"scheduling_latency_s":2.646322}1451gitlab # [ 139.570937] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56b61534f48873fd7b61d890","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56b61534f48873fd7b61d890: done: 0.009027 sec","job_status":"done","queue_duration_s":2.646305,"scheduling_latency_s":2.646322,"redis_calls":13,"redis_duration_s":0.001849,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009027,"completed_at":"2026-07-25T09:40:32.434Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 139.635765] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6508e3d3074b95a342fe940e","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6508e3d3074b95a342fe940e: start","job_status":"start","queue_duration_s":2.661219,"scheduling_latency_s":2.661233}1453gitlab # [ 139.636420] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6508e3d3074b95a342fe940e","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6508e3d3074b95a342fe940e: done: 0.0182 sec","job_status":"done","queue_duration_s":2.661219,"scheduling_latency_s":2.661233,"redis_calls":13,"redis_duration_s":0.009776,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002198,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007578,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0182,"completed_at":"2026-07-25T09:40:32.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 139.684337] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"899f6ac9f04f9d2daf151ec4","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-899f6ac9f04f9d2daf151ec4: start","job_status":"start","queue_duration_s":2.681555,"scheduling_latency_s":2.681569}1455gitlab # [ 139.685207] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"899f6ac9f04f9d2daf151ec4","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-899f6ac9f04f9d2daf151ec4: done: 0.009429 sec","job_status":"done","queue_duration_s":2.681555,"scheduling_latency_s":2.681569,"redis_calls":13,"redis_duration_s":0.002313,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001626,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009429,"completed_at":"2026-07-25T09:40:32.469Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 139.731762] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab484a1651effd88f77b1b8f","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab484a1651effd88f77b1b8f: start","job_status":"start","queue_duration_s":2.691863,"scheduling_latency_s":2.691875}1457gitlab # [ 139.732727] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab484a1651effd88f77b1b8f","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab484a1651effd88f77b1b8f: done: 0.009482 sec","job_status":"done","queue_duration_s":2.691863,"scheduling_latency_s":2.691875,"redis_calls":13,"redis_duration_s":0.002351,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001707,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009482,"completed_at":"2026-07-25T09:40:32.480Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 139.744838] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b31781bcc4fb8cdda23d0bb","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b31781bcc4fb8cdda23d0bb: start","job_status":"start","queue_duration_s":2.702276,"scheduling_latency_s":2.702289}1459gitlab # [ 139.756206] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b31781bcc4fb8cdda23d0bb","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b31781bcc4fb8cdda23d0bb: done: 0.009179 sec","job_status":"done","queue_duration_s":2.702276,"scheduling_latency_s":2.702289,"redis_calls":13,"redis_duration_s":0.002063,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001379,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009179,"completed_at":"2026-07-25T09:40:32.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 139.817154] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70388484d63fd75568be887b","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70388484d63fd75568be887b: start","job_status":"start","queue_duration_s":2.712656,"scheduling_latency_s":2.712669}1461gitlab # [ 139.817949] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70388484d63fd75568be887b","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70388484d63fd75568be887b: done: 0.012904 sec","job_status":"done","queue_duration_s":2.712656,"scheduling_latency_s":2.712669,"redis_calls":13,"redis_duration_s":0.0056300000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004471,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012904,"completed_at":"2026-07-25T09:40:32.504Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 139.836636] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98e65936a23fd55ada58b57d","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98e65936a23fd55ada58b57d: start","job_status":"start","queue_duration_s":2.728063,"scheduling_latency_s":2.728075}1463gitlab # [ 139.874633] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98e65936a23fd55ada58b57d","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98e65936a23fd55ada58b57d: done: 0.010195 sec","job_status":"done","queue_duration_s":2.728063,"scheduling_latency_s":2.728075,"redis_calls":13,"redis_duration_s":0.00214,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001455,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010195,"completed_at":"2026-07-25T09:40:32.517Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 139.914828] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7489d82613101084a11a7d1","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7489d82613101084a11a7d1: start","job_status":"start","queue_duration_s":2.739156,"scheduling_latency_s":2.739168}1465gitlab # [ 139.915455] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7489d82613101084a11a7d1","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7489d82613101084a11a7d1: done: 0.009289 sec","job_status":"done","queue_duration_s":2.739156,"scheduling_latency_s":2.739168,"redis_calls":13,"redis_duration_s":0.002085,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001406,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009289,"completed_at":"2026-07-25T09:40:32.527Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 139.926050] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f22ebb18d6768724d8ce1b3b","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f22ebb18d6768724d8ce1b3b: start","job_status":"start","queue_duration_s":2.74939,"scheduling_latency_s":2.749404}1467gitlab # [ 139.936945] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f22ebb18d6768724d8ce1b3b","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f22ebb18d6768724d8ce1b3b: done: 0.009389 sec","job_status":"done","queue_duration_s":2.74939,"scheduling_latency_s":2.749404,"redis_calls":13,"redis_duration_s":0.002048,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001412,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009389,"completed_at":"2026-07-25T09:40:32.537Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 139.990152] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"959da3d852a2a77bdecb4e68","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-959da3d852a2a77bdecb4e68: start","job_status":"start","queue_duration_s":2.760123,"scheduling_latency_s":2.760136}1469gitlab # [ 139.990826] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"959da3d852a2a77bdecb4e68","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-959da3d852a2a77bdecb4e68: done: 0.009362 sec","job_status":"done","queue_duration_s":2.760123,"scheduling_latency_s":2.760136,"redis_calls":13,"redis_duration_s":0.0020499999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001367,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009362,"completed_at":"2026-07-25T09:40:32.548Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 140.030171] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8faeae021fd7bf7e6567936a","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8faeae021fd7bf7e6567936a: start","job_status":"start","queue_duration_s":2.77419,"scheduling_latency_s":2.774204}1471gitlab # [ 140.030774] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8faeae021fd7bf7e6567936a","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8faeae021fd7bf7e6567936a: done: 0.010502 sec","job_status":"done","queue_duration_s":2.77419,"scheduling_latency_s":2.774204,"redis_calls":13,"redis_duration_s":0.002162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001502,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010502,"completed_at":"2026-07-25T09:40:32.563Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 140.084056] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f358eac6bb83dd2c3ad55f2","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f358eac6bb83dd2c3ad55f2: start","job_status":"start","queue_duration_s":2.785625,"scheduling_latency_s":2.785639}1473gitlab # [ 140.084491] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f358eac6bb83dd2c3ad55f2","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f358eac6bb83dd2c3ad55f2: done: 0.009232 sec","job_status":"done","queue_duration_s":2.785625,"scheduling_latency_s":2.785639,"redis_calls":13,"redis_duration_s":0.002006,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001363,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009232,"completed_at":"2026-07-25T09:40:32.573Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 140.131820] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb8d7e0f7ec23a04be1e1af2","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb8d7e0f7ec23a04be1e1af2: start","job_status":"start","queue_duration_s":2.795777,"scheduling_latency_s":2.795791}1475gitlab # [ 140.132591] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb8d7e0f7ec23a04be1e1af2","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb8d7e0f7ec23a04be1e1af2: done: 0.009184 sec","job_status":"done","queue_duration_s":2.795777,"scheduling_latency_s":2.795791,"redis_calls":13,"redis_duration_s":0.001992,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001355,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009184,"completed_at":"2026-07-25T09:40:32.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 140.181830] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58c597eccc04152b934b7657","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58c597eccc04152b934b7657: start","job_status":"start","queue_duration_s":2.806294,"scheduling_latency_s":2.806307}1477gitlab # [ 140.182718] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:40:32.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58c597eccc04152b934b7657","created_at":"2026-07-25T09:40:29.735Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-0b928866bb7f4e4e","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f00bdb44f3b445fe495b6cb34659a0ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:40:29.778Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58c597eccc04152b934b7657: done: 0.009959 sec","job_status":"done","queue_duration_s":2.806294,"scheduling_latency_s":2.806307,"redis_calls":13,"redis_duration_s":0.002649,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009959,"completed_at":"2026-07-25T09:40:32.595Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 153.941352] setup-gitlab-start[2611]: W, [2026-07-25T09:40:46.804190 #2611] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1479gitlab # [ 175.068165] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:07.930Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b770d6be1a7d8f6c18c8853e","created_at":"2026-07-25T09:41:07.882Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6f8871a844886034c17fd3180f04a71","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:07.927Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b770d6be1a7d8f6c18c8853e: start","job_status":"start","queue_duration_s":0.002757,"scheduling_latency_s":0.002806}1480gitlab # [ 175.203701] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.065Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b770d6be1a7d8f6c18c8853e","created_at":"2026-07-25T09:41:07.882Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6f8871a844886034c17fd3180f04a71","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:07.927Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b770d6be1a7d8f6c18c8853e: done: 0.135391 sec","job_status":"done","queue_duration_s":0.002757,"scheduling_latency_s":0.002806,"redis_calls":9,"redis_duration_s":0.012892999999999998,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004063,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.057,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002170947,"exclusive_lock_hold_duration_s":0.0596235,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.135391,"completed_at":"2026-07-25T09:41:08.065Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.090776,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 175.262409] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.125Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"f6a89a73a14fa3adcea5ef86","created_at":"2026-07-25T09:41:07.961Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c42d6cdc306363ffbe05db14ea92ef8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:07.966Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-f6a89a73a14fa3adcea5ef86: start","job_status":"start","queue_duration_s":0.159122,"scheduling_latency_s":0.159149}1482gitlab # [ 175.299246] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.162Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1483gitlab # [ 175.321959] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.184Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"f6a89a73a14fa3adcea5ef86","created_at":"2026-07-25T09:41:07.961Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c42d6cdc306363ffbe05db14ea92ef8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:07.966Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-f6a89a73a14fa3adcea5ef86: done: 0.059252 sec","job_status":"done","queue_duration_s":0.159122,"scheduling_latency_s":0.159149,"redis_calls":7,"redis_duration_s":0.019027,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.016838,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002189,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059252,"completed_at":"2026-07-25T09:41:08.184Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 175.348137] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.195Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"053f6ebe3b6f27aa7c331a91","created_at":"2026-07-25T09:41:07.986Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7bd663a3c94cdd720268cc21d57a0488","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:07.992Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-053f6ebe3b6f27aa7c331a91: start","job_status":"start","queue_duration_s":0.203458,"scheduling_latency_s":0.2035}1485gitlab # [ 175.438922] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.302Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"053f6ebe3b6f27aa7c331a91","created_at":"2026-07-25T09:41:07.986Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7bd663a3c94cdd720268cc21d57a0488","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:07.992Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-053f6ebe3b6f27aa7c331a91: done: 0.106648 sec","job_status":"done","queue_duration_s":0.203458,"scheduling_latency_s":0.2035,"redis_calls":7,"redis_duration_s":0.03119,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.028009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003181,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.106648,"completed_at":"2026-07-25T09:41:08.302Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 175.441064] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e43f2ca0acca4ae4e3e1194a","created_at":"2026-07-25T09:41:08.006Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a48b84294fbfb4ce433cdd628a50a956","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.009Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e43f2ca0acca4ae4e3e1194a: start","job_status":"start","queue_duration_s":0.294933,"scheduling_latency_s":0.294962}1487gitlab # [ 175.490875] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e43f2ca0acca4ae4e3e1194a","created_at":"2026-07-25T09:41:08.006Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a48b84294fbfb4ce433cdd628a50a956","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.009Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e43f2ca0acca4ae4e3e1194a: done: 0.025437 sec","job_status":"done","queue_duration_s":0.294933,"scheduling_latency_s":0.294962,"redis_calls":9,"redis_duration_s":0.001531,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000745,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000358705,"exclusive_lock_hold_duration_s":0.008719265,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.025437,"completed_at":"2026-07-25T09:41:08.329Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007949,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 175.498695] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.330Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8c79dd5e34b8c5feea862f7a","created_at":"2026-07-25T09:41:08.043Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05ee512e06cb3b907f1a21fdd2d5b4f6","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.051Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8c79dd5e34b8c5feea862f7a: start","job_status":"start","queue_duration_s":0.278577,"scheduling_latency_s":0.278589}1489gitlab # [ 175.512049] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.341Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8c79dd5e34b8c5feea862f7a","created_at":"2026-07-25T09:41:08.043Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05ee512e06cb3b907f1a21fdd2d5b4f6","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.051Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8c79dd5e34b8c5feea862f7a: done: 0.011316 sec","job_status":"done","queue_duration_s":0.278577,"scheduling_latency_s":0.278589,"redis_calls":10,"redis_duration_s":0.00134,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000582,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002387455,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.011316,"completed_at":"2026-07-25T09:41:08.341Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001265,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1490gitlab # [ 175.553141] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.342Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"57c32c7794f780163ef1d90b","created_at":"2026-07-25T09:41:08.064Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c655a1a9fd02228731b7842d87f3f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.125Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-57c32c7794f780163ef1d90b: start","job_status":"start","queue_duration_s":0.217249,"scheduling_latency_s":0.217263}1491gitlab # [ 175.562206] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.354Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"57c32c7794f780163ef1d90b","created_at":"2026-07-25T09:41:08.064Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c655a1a9fd02228731b7842d87f3f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.125Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-57c32c7794f780163ef1d90b: done: 0.012147 sec","job_status":"done","queue_duration_s":0.217249,"scheduling_latency_s":0.217263,"redis_calls":7,"redis_duration_s":0.0010379999999999999,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.012147,"completed_at":"2026-07-25T09:41:08.354Z","load_balancing_strategy":"primary","db_duration_s":0.003993,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 175.621220] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.355Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"032764c26ef31d6533041965","created_at":"2026-07-25T09:41:08.159Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f17d14f3f7520820761280de4ef3f9ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.169Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-032764c26ef31d6533041965: start","job_status":"start","queue_duration_s":0.186292,"scheduling_latency_s":0.186306}1493gitlab # [ 175.621799] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.360Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1494gitlab # [ 175.622635] runuser[2610]: pam_unix(runuser:session): session closed for user gitlab1495gitlab # [ 175.623285] setup-gitlab-start[2821]: +++ date -d '+7 days' +%F1496gitlab # [ 175.623470] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.363Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"032764c26ef31d6533041965","created_at":"2026-07-25T09:41:08.159Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f17d14f3f7520820761280de4ef3f9ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.169Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-032764c26ef31d6533041965: done: 0.0074 sec","job_status":"done","queue_duration_s":0.186292,"scheduling_latency_s":0.186306,"redis_calls":7,"redis_duration_s":0.0009029999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0074,"completed_at":"2026-07-25T09:41:08.363Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 175.663075] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"7f81db9578775c5cc7465384","created_at":"2026-07-25T09:41:08.179Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7df0135dfe61f98e40da6bf465e16675","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.182Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-7f81db9578775c5cc7465384: start","job_status":"start","queue_duration_s":0.181609,"scheduling_latency_s":0.181622}1498gitlab # [ 175.703395] setup-gitlab-start[2819]: ++ curl -fs -X POST -H 'Authorization: Bearer 03253dc094ce5ea7bc9e4265b746b9c510b06afc1cda58ad6bf9ccb123a0565d' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-08-01"}' http://gitlab/api/v4/users/1/personal_access_tokens1499gitlab # [ 175.704049] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.374Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"7f81db9578775c5cc7465384","created_at":"2026-07-25T09:41:08.179Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7df0135dfe61f98e40da6bf465e16675","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.182Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-7f81db9578775c5cc7465384: done: 0.010311 sec","job_status":"done","queue_duration_s":0.181609,"scheduling_latency_s":0.181622,"redis_calls":7,"redis_duration_s":0.0009,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010311,"completed_at":"2026-07-25T09:41:08.374Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 175.704956] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"51b181c719e225414e53dcf6","created_at":"2026-07-25T09:41:08.197Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26d2ec54f84d71fa9e6c6f623d1682bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.200Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-51b181c719e225414e53dcf6: start","job_status":"start","queue_duration_s":0.174941,"scheduling_latency_s":0.174954}1501gitlab # [ 175.748964] setup-gitlab-start[2820]: ++ jq -r .token1502gitlab # [ 175.749700] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.553Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"51b181c719e225414e53dcf6","created_at":"2026-07-25T09:41:08.197Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26d2ec54f84d71fa9e6c6f623d1682bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.200Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-51b181c719e225414e53dcf6: done: 0.178218 sec","job_status":"done","queue_duration_s":0.174941,"scheduling_latency_s":0.174954,"redis_calls":9,"redis_duration_s":0.001458,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000708,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":123,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":123,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":123,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":80,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.044,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000291657,"exclusive_lock_hold_duration_s":0.168622269,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.178218,"completed_at":"2026-07-25T09:41:08.553Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.088314,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 175.792509] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.554Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"71731995b24aa3a1e7dd7c5a","created_at":"2026-07-25T09:41:08.226Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d555ad8d66b7c7c74d84f94a143c09c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.229Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-71731995b24aa3a1e7dd7c5a: start","job_status":"start","queue_duration_s":0.325539,"scheduling_latency_s":0.325578}1504gitlab # [ 175.793175] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.568Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"71731995b24aa3a1e7dd7c5a","created_at":"2026-07-25T09:41:08.226Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d555ad8d66b7c7c74d84f94a143c09c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.229Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-71731995b24aa3a1e7dd7c5a: done: 0.013281 sec","job_status":"done","queue_duration_s":0.325539,"scheduling_latency_s":0.325578,"redis_calls":9,"redis_duration_s":0.0015999999999999999,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000801,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000634438,"exclusive_lock_hold_duration_s":0.002885283,"duration_s":0.013281,"completed_at":"2026-07-25T09:41:08.567Z","load_balancing_strategy":"primary","db_duration_s":0.000669,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 175.805924] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.569Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"05be4413071d9ce4af795914","created_at":"2026-07-25T09:41:08.240Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c65ae73c0a2654462f8e42b884fb80ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-25T09:41:08.242Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-05be4413071d9ce4af795914: start","job_status":"start","queue_duration_s":0.326696,"scheduling_latency_s":0.326709}1506gitlab # [ 175.818814] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.573Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1507gitlab # [ 175.822543] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.577Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"05be4413071d9ce4af795914","created_at":"2026-07-25T09:41:08.240Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c65ae73c0a2654462f8e42b884fb80ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-25T09:41:08.242Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-05be4413071d9ce4af795914: done: 0.00804 sec","job_status":"done","queue_duration_s":0.326696,"scheduling_latency_s":0.326709,"redis_calls":7,"redis_duration_s":0.000865,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.00804,"completed_at":"2026-07-25T09:41:08.577Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 175.896867] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.578Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0f83b3783bc8659e7493b40d","created_at":"2026-07-25T09:41:08.257Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdc90d4ed68c2499899754d2cdfd7cd0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-25T09:41:08.259Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0f83b3783bc8659e7493b40d: start","job_status":"start","queue_duration_s":0.318234,"scheduling_latency_s":0.318255}1509gitlab # [ 175.897730] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.583Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1510gitlab # [ 175.898477] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.587Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0f83b3783bc8659e7493b40d","created_at":"2026-07-25T09:41:08.257Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdc90d4ed68c2499899754d2cdfd7cd0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-25T09:41:08.259Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0f83b3783bc8659e7493b40d: done: 0.009393 sec","job_status":"done","queue_duration_s":0.318234,"scheduling_latency_s":0.318255,"redis_calls":7,"redis_duration_s":0.001007,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000345,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009393,"completed_at":"2026-07-25T09:41:08.587Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 175.912689] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.588Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7c3aaf7ca5051fefa443308d","created_at":"2026-07-25T09:41:08.294Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ebbb91b24920dbc86ca2b01da94db3f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.298Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7c3aaf7ca5051fefa443308d: start","job_status":"start","queue_duration_s":0.290208,"scheduling_latency_s":0.290221}1512gitlab # [ 175.926737] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.608Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7c3aaf7ca5051fefa443308d","created_at":"2026-07-25T09:41:08.294Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ebbb91b24920dbc86ca2b01da94db3f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.298Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7c3aaf7ca5051fefa443308d: done: 0.020188 sec","job_status":"done","queue_duration_s":0.290208,"scheduling_latency_s":0.290221,"redis_calls":9,"redis_duration_s":0.0012959999999999998,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000669,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000627,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000334121,"exclusive_lock_hold_duration_s":0.010804166,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.020188,"completed_at":"2026-07-25T09:41:08.608Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005155,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 175.984151] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.609Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"deccb98ffa14f37880ca8dd6","created_at":"2026-07-25T09:41:08.402Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da0af7009562326b38677d190b679901","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.407Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-deccb98ffa14f37880ca8dd6: start","job_status":"start","queue_duration_s":0.202452,"scheduling_latency_s":0.202465}1514gitlab # [ 175.984832] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.619Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"deccb98ffa14f37880ca8dd6","created_at":"2026-07-25T09:41:08.402Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da0af7009562326b38677d190b679901","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.407Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-deccb98ffa14f37880ca8dd6: done: 0.010251 sec","job_status":"done","queue_duration_s":0.202452,"scheduling_latency_s":0.202465,"redis_calls":9,"redis_duration_s":0.001186,"redis_read_bytes":7,"redis_write_bytes":1053,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":277,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010251,"completed_at":"2026-07-25T09:41:08.619Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000895,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 176.027529] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"03c32cb86e8a644af09245fc","created_at":"2026-07-25T09:41:08.411Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa5ae04e70c26af308865a372bd18322","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.415Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-03c32cb86e8a644af09245fc: start","job_status":"start","queue_duration_s":0.205105,"scheduling_latency_s":0.205117}1516gitlab # [ 176.030280] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"03c32cb86e8a644af09245fc","created_at":"2026-07-25T09:41:08.411Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa5ae04e70c26af308865a372bd18322","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.415Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-03c32cb86e8a644af09245fc: done: 0.203858 sec","job_status":"done","queue_duration_s":0.205105,"scheduling_latency_s":0.205117,"redis_calls":571,"redis_duration_s":0.062065,"redis_read_bytes":569,"redis_write_bytes":49487,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.061407,"redis_shared_state_read_bytes":565,"redis_shared_state_write_bytes":49017,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.161974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.203858,"completed_at":"2026-07-25T09:41:08.824Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 176.071057] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.825Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"0c07c4d754df6bd5273c7696","created_at":"2026-07-25T09:41:08.419Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48ea556facda35dfab281c9221005f2e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.421Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-0c07c4d754df6bd5273c7696: start","job_status":"start","queue_duration_s":0.404344,"scheduling_latency_s":0.404363}1518gitlab # [ 176.112636] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"0c07c4d754df6bd5273c7696","created_at":"2026-07-25T09:41:08.419Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48ea556facda35dfab281c9221005f2e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.421Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-0c07c4d754df6bd5273c7696: done: 0.007974 sec","job_status":"done","queue_duration_s":0.404344,"scheduling_latency_s":0.404363,"redis_calls":7,"redis_duration_s":0.000851,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007974,"completed_at":"2026-07-25T09:41:08.833Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 176.152726] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.834Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"48c865115894c154f05c7bde","created_at":"2026-07-25T09:41:08.430Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18a9dcd1404a52c4745033bb8297b279","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.432Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-48c865115894c154f05c7bde: start","job_status":"start","queue_duration_s":0.402546,"scheduling_latency_s":0.402577}1520gitlab # [ 176.153611] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.840Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1521gitlab # [ 176.154195] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.844Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"48c865115894c154f05c7bde","created_at":"2026-07-25T09:41:08.430Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18a9dcd1404a52c4745033bb8297b279","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.432Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-48c865115894c154f05c7bde: done: 0.009652 sec","job_status":"done","queue_duration_s":0.402546,"scheduling_latency_s":0.402577,"redis_calls":7,"redis_duration_s":0.0008500000000000001,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000607,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009652,"completed_at":"2026-07-25T09:41:08.844Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 176.170146] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"66fb0d5d78d1daaa4515bc41","created_at":"2026-07-25T09:41:08.436Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dcf0e2d5e78f3eb2a547434911b1bbfe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.438Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-66fb0d5d78d1daaa4515bc41: start","job_status":"start","queue_duration_s":0.406555,"scheduling_latency_s":0.406568}1523gitlab # [ 176.182914] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.860Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"66fb0d5d78d1daaa4515bc41","created_at":"2026-07-25T09:41:08.436Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dcf0e2d5e78f3eb2a547434911b1bbfe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.438Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-66fb0d5d78d1daaa4515bc41: done: 0.014751 sec","job_status":"done","queue_duration_s":0.406555,"scheduling_latency_s":0.406568,"redis_calls":14,"redis_duration_s":0.001782,"redis_read_bytes":15,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000183,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001137,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014751,"completed_at":"2026-07-25T09:41:08.859Z","load_balancing_strategy":"primary","db_duration_s":0.000932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 176.237190] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.860Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"cf656f12509bf7916fd6af44","created_at":"2026-07-25T09:41:08.442Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.445Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-cf656f12509bf7916fd6af44: start","job_status":"start","queue_duration_s":0.415335,"scheduling_latency_s":0.415348}1525gitlab # [ 176.237878] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"cf656f12509bf7916fd6af44","created_at":"2026-07-25T09:41:08.442Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.445Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-cf656f12509bf7916fd6af44: done: 0.048017 sec","job_status":"done","queue_duration_s":0.415335,"scheduling_latency_s":0.415348,"redis_calls":60,"redis_duration_s":0.007655,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.0005,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.006614,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048017,"completed_at":"2026-07-25T09:41:08.908Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 176.309326] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.909Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"76415974e543870bba6dd480","created_at":"2026-07-25T09:41:08.452Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e4211aab777f09a897ba436c381c1c6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.454Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-76415974e543870bba6dd480: start","job_status":"start","queue_duration_s":0.45518,"scheduling_latency_s":0.455196}1527gitlab # [ 176.309888] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.914Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1528gitlab # [ 176.310449] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"76415974e543870bba6dd480","created_at":"2026-07-25T09:41:08.452Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e4211aab777f09a897ba436c381c1c6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.454Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-76415974e543870bba6dd480: done: 0.007149 sec","job_status":"done","queue_duration_s":0.45518,"scheduling_latency_s":0.455196,"redis_calls":7,"redis_duration_s":0.000863,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007149,"completed_at":"2026-07-25T09:41:08.916Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 176.325428] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.917Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"051d0b8fca9a0d81183c63d0","created_at":"2026-07-25T09:41:08.459Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"819cc9a16fa3f61bcbebbc752d104989","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-25T09:41:08.461Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-051d0b8fca9a0d81183c63d0: start","job_status":"start","queue_duration_s":0.456342,"scheduling_latency_s":0.456354}1530gitlab # [ 176.371125] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.929Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"051d0b8fca9a0d81183c63d0","created_at":"2026-07-25T09:41:08.459Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-fbddf3c643fc42ea","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"819cc9a16fa3f61bcbebbc752d104989","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-25T09:41:08.461Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-051d0b8fca9a0d81183c63d0: done: 0.012003 sec","job_status":"done","queue_duration_s":0.456342,"scheduling_latency_s":0.456354,"redis_calls":7,"redis_duration_s":0.000887,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012003,"completed_at":"2026-07-25T09:41:08.929Z","load_balancing_strategy":"primary","db_duration_s":0.001109,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 176.413316] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.930Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"84f192925f6ef9e00b988dd2","created_at":"2026-07-25T09:41:08.851Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-6f315f47490a4dca","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dcf0e2d5e78f3eb2a547434911b1bbfe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.857Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-84f192925f6ef9e00b988dd2: start","job_status":"start","queue_duration_s":0.073362,"scheduling_latency_s":0.073375}1532gitlab # [ 176.414074] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.936Z","message":"No existing merge request to be cleaned up."}1533gitlab # [ 176.414602] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.940Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"84f192925f6ef9e00b988dd2","created_at":"2026-07-25T09:41:08.851Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-6f315f47490a4dca","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dcf0e2d5e78f3eb2a547434911b1bbfe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.857Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-84f192925f6ef9e00b988dd2: done: 0.010037 sec","job_status":"done","queue_duration_s":0.073362,"scheduling_latency_s":0.073375,"redis_calls":10,"redis_duration_s":0.0012820000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000769,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010037,"completed_at":"2026-07-25T09:41:08.940Z","load_balancing_strategy":"primary","db_duration_s":0.001049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 176.422194] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.941Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8b96ef109af8ee05e537fe87","created_at":"2026-07-25T09:41:08.851Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-6f315f47490a4dca","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dcf0e2d5e78f3eb2a547434911b1bbfe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.857Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8b96ef109af8ee05e537fe87: start","job_status":"start","queue_duration_s":0.084195,"scheduling_latency_s":0.084209}1535gitlab # [ 176.471588] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.946Z","message":"No existing merge request to be cleaned up."}1536gitlab # [ 176.472493] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.950Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8b96ef109af8ee05e537fe87","created_at":"2026-07-25T09:41:08.851Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-6f315f47490a4dca","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dcf0e2d5e78f3eb2a547434911b1bbfe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.857Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8b96ef109af8ee05e537fe87: done: 0.009493 sec","job_status":"done","queue_duration_s":0.084195,"scheduling_latency_s":0.084209,"redis_calls":10,"redis_duration_s":0.001235,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000714,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009493,"completed_at":"2026-07-25T09:41:08.950Z","load_balancing_strategy":"primary","db_duration_s":0.000911,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 176.473672] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.951Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"43b8c47d29543228f08c2dc7","created_at":"2026-07-25T09:41:08.851Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-6f315f47490a4dca","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dcf0e2d5e78f3eb2a547434911b1bbfe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.857Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-43b8c47d29543228f08c2dc7: start","job_status":"start","queue_duration_s":0.094477,"scheduling_latency_s":0.09449}1538gitlab # [ 176.481930] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.957Z","message":"No existing merge request to be cleaned up."}1539gitlab # [ 176.483612] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.961Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"43b8c47d29543228f08c2dc7","created_at":"2026-07-25T09:41:08.851Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-6f315f47490a4dca","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dcf0e2d5e78f3eb2a547434911b1bbfe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.857Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-43b8c47d29543228f08c2dc7: done: 0.009505 sec","job_status":"done","queue_duration_s":0.094477,"scheduling_latency_s":0.09449,"redis_calls":10,"redis_duration_s":0.001297,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000777,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009505,"completed_at":"2026-07-25T09:41:08.961Z","load_balancing_strategy":"primary","db_duration_s":0.000879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 176.550767] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.961Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5248836741a013d28cb9826e","created_at":"2026-07-25T09:41:08.851Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-6f315f47490a4dca","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dcf0e2d5e78f3eb2a547434911b1bbfe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.857Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5248836741a013d28cb9826e: start","job_status":"start","queue_duration_s":0.104758,"scheduling_latency_s":0.104771}1541gitlab # [ 176.551641] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.967Z","message":"No existing merge request to be cleaned up."}1542gitlab # [ 176.552161] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.971Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5248836741a013d28cb9826e","created_at":"2026-07-25T09:41:08.851Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-6f315f47490a4dca","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"dcf0e2d5e78f3eb2a547434911b1bbfe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.857Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5248836741a013d28cb9826e: done: 0.0097 sec","job_status":"done","queue_duration_s":0.104758,"scheduling_latency_s":0.104771,"redis_calls":10,"redis_duration_s":0.001407,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0097,"completed_at":"2026-07-25T09:41:08.971Z","load_balancing_strategy":"primary","db_duration_s":0.000943,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 176.604731] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c6ec5d017e3b33d999640ec","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c6ec5d017e3b33d999640ec: start","job_status":"start","queue_duration_s":0.067761,"scheduling_latency_s":0.067775}1544gitlab # [ 176.605646] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c6ec5d017e3b33d999640ec","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c6ec5d017e3b33d999640ec: done: 0.008577 sec","job_status":"done","queue_duration_s":0.067761,"scheduling_latency_s":0.067775,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008577,"completed_at":"2026-07-25T09:41:08.980Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 176.653993] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcf837bbfbfc0928d2a0dc96","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcf837bbfbfc0928d2a0dc96: start","job_status":"start","queue_duration_s":0.07709,"scheduling_latency_s":0.077189}1546gitlab # [ 176.665787] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:09 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 8711547gitlab # [ 176.666279] setup-gitlab-start[2559]: + TOKEN=glpat-aL7yM8l67Mgn4Eg7PVptXm86MQp1OjEH.01.0w0jelon51548gitlab # [ 176.666398] setup-gitlab-start[2559]: + test -n glpat-aL7yM8l67Mgn4Eg7PVptXm86MQp1OjEH.01.0w0jelon51549gitlab # [ 176.666852] setup-gitlab-start[2559]: + test glpat-aL7yM8l67Mgn4Eg7PVptXm86MQp1OjEH.01.0w0jelon5 '!=' null1550gitlab # [ 176.667684] setup-gitlab-start[2559]: + mkdir -p /var/lib/secrets1551gitlab # [ 176.670403] setup-gitlab-start[2559]: + echo glpat-aL7yM8l67Mgn4Eg7PVptXm86MQp1OjEH.01.0w0jelon51552gitlab # [ 176.671087] setup-gitlab-start[2559]: + chmod 644 /var/lib/secrets/gitlab-token1553gitlab # [ 176.671379] setup-gitlab-start[2559]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-aL7yM8l67Mgn4Eg7PVptXm86MQp1OjEH.01.0w0jelon5' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1554gitlab # [ 176.671888] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcf837bbfbfc0928d2a0dc96","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcf837bbfbfc0928d2a0dc96: done: 0.014778 sec","job_status":"done","queue_duration_s":0.07709,"scheduling_latency_s":0.077189,"redis_calls":13,"redis_duration_s":0.0014719999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014778,"completed_at":"2026-07-25T09:41:08.996Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 176.672864] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:08.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"739669416581e39f8b6f9195","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-739669416581e39f8b6f9195: start","job_status":"start","queue_duration_s":0.092727,"scheduling_latency_s":0.09274}1556gitlab # [ 176.682941] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"739669416581e39f8b6f9195","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-739669416581e39f8b6f9195: done: 0.008547 sec","job_status":"done","queue_duration_s":0.092727,"scheduling_latency_s":0.09274,"redis_calls":13,"redis_duration_s":0.001518,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008547,"completed_at":"2026-07-25T09:41:09.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 176.729186] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9140f7ad94205f73eaa97c61","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9140f7ad94205f73eaa97c61: start","job_status":"start","queue_duration_s":0.102023,"scheduling_latency_s":0.102036}1558gitlab # [ 176.729927] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9140f7ad94205f73eaa97c61","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9140f7ad94205f73eaa97c61: done: 0.008311 sec","job_status":"done","queue_duration_s":0.102023,"scheduling_latency_s":0.102036,"redis_calls":13,"redis_duration_s":0.001469,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008311,"completed_at":"2026-07-25T09:41:09.014Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 176.769611] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"529a8c8716e80f27c5e0cc2e","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-529a8c8716e80f27c5e0cc2e: start","job_status":"start","queue_duration_s":0.111093,"scheduling_latency_s":0.111106}1560gitlab # [ 176.775911] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"529a8c8716e80f27c5e0cc2e","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-529a8c8716e80f27c5e0cc2e: done: 0.008378 sec","job_status":"done","queue_duration_s":0.111093,"scheduling_latency_s":0.111106,"redis_calls":13,"redis_duration_s":0.001491,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008378,"completed_at":"2026-07-25T09:41:09.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 176.822984] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8cfdad1f2eee561c55c9244","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8cfdad1f2eee561c55c9244: start","job_status":"start","queue_duration_s":0.120245,"scheduling_latency_s":0.120265}1562gitlab # [ 176.823746] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8cfdad1f2eee561c55c9244","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8cfdad1f2eee561c55c9244: done: 0.008361 sec","job_status":"done","queue_duration_s":0.120245,"scheduling_latency_s":0.120265,"redis_calls":13,"redis_duration_s":0.001428,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008361,"completed_at":"2026-07-25T09:41:09.033Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 176.867482] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49392c76c04611767418b3ac","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49392c76c04611767418b3ac: start","job_status":"start","queue_duration_s":0.129794,"scheduling_latency_s":0.129827}1564gitlab # [ 176.868126] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49392c76c04611767418b3ac","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49392c76c04611767418b3ac: done: 0.011498 sec","job_status":"done","queue_duration_s":0.129794,"scheduling_latency_s":0.129827,"redis_calls":13,"redis_duration_s":0.0015439999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011498,"completed_at":"2026-07-25T09:41:09.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 176.914765] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf1ffaac67904b57778dd337","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf1ffaac67904b57778dd337: start","job_status":"start","queue_duration_s":0.142102,"scheduling_latency_s":0.142115}1566gitlab # [ 176.915723] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf1ffaac67904b57778dd337","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf1ffaac67904b57778dd337: done: 0.008675 sec","job_status":"done","queue_duration_s":0.142102,"scheduling_latency_s":0.142115,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008675,"completed_at":"2026-07-25T09:41:09.055Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 176.976255] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf2aa90fd7bdba25690f63d2","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf2aa90fd7bdba25690f63d2: start","job_status":"start","queue_duration_s":0.151565,"scheduling_latency_s":0.151578}1568gitlab # [ 176.976974] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf2aa90fd7bdba25690f63d2","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf2aa90fd7bdba25690f63d2: done: 0.008562 sec","job_status":"done","queue_duration_s":0.151565,"scheduling_latency_s":0.151578,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008562,"completed_at":"2026-07-25T09:41:09.064Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 176.992869] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03ba5d75ae761746563cfc3c","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03ba5d75ae761746563cfc3c: start","job_status":"start","queue_duration_s":0.160928,"scheduling_latency_s":0.160941}1570gitlab # [ 177.005130] gitaly[1356]: time="2026-07-25T09:41:09.793Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:41:19.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.793" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1571gitlab # [ 177.051903] gitaly[1356]: time="2026-07-25T09:41:09.793Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:41:19.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.793" grpc.time_ms=0.262 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1572gitlab # [ 177.052661] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03ba5d75ae761746563cfc3c","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03ba5d75ae761746563cfc3c: done: 0.008765 sec","job_status":"done","queue_duration_s":0.160928,"scheduling_latency_s":0.160941,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008765,"completed_at":"2026-07-25T09:41:09.074Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 177.061058] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f98b7d9d46a47862bebdd63b","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f98b7d9d46a47862bebdd63b: start","job_status":"start","queue_duration_s":0.170482,"scheduling_latency_s":0.170495}1574gitlab # [ 177.102952] gitaly[1356]: time="2026-07-25T09:41:09.857Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:41:19.067" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.857" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1575gitlab # [ 177.103694] gitaly[1356]: time="2026-07-25T09:41:09.858Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:41:19.067" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.857" grpc.time_ms=0.227 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1576gitlab # [ 177.104767] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f98b7d9d46a47862bebdd63b","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f98b7d9d46a47862bebdd63b: done: 0.008496 sec","job_status":"done","queue_duration_s":0.170482,"scheduling_latency_s":0.170495,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008496,"completed_at":"2026-07-25T09:41:09.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 177.145706] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"483ff9f08ded434547a1974f","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-483ff9f08ded434547a1974f: start","job_status":"start","queue_duration_s":0.17976,"scheduling_latency_s":0.179772}1578gitlab # [ 177.146528] gitaly[1356]: time="2026-07-25T09:41:09.891Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y diskcache=1b292641-87e5-4daf-9833-df52f487ec79 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-25T09:41:19.071" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.861" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1579gitlab # [ 177.149259] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"483ff9f08ded434547a1974f","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-483ff9f08ded434547a1974f: done: 0.011147 sec","job_status":"done","queue_duration_s":0.17976,"scheduling_latency_s":0.179772,"redis_calls":13,"redis_duration_s":0.0016359999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011147,"completed_at":"2026-07-25T09:41:09.095Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580gitlab # [ 177.188723] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9f3b4e8094262fed6670c24","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9f3b4e8094262fed6670c24: start","job_status":"start","queue_duration_s":0.191902,"scheduling_latency_s":0.191922}1581gitlab # [ 177.195809] gitaly[1356]: time="2026-07-25T09:41:09.891Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=32 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-25T09:41:19.071" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.861" grpc.time_ms=29.528 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1582gitlab # [ 177.239979] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9f3b4e8094262fed6670c24","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9f3b4e8094262fed6670c24: done: 0.00948 sec","job_status":"done","queue_duration_s":0.191902,"scheduling_latency_s":0.191922,"redis_calls":13,"redis_duration_s":0.001705,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00948,"completed_at":"2026-07-25T09:41:09.105Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 177.241806] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97591b0075aa75ae70562140","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97591b0075aa75ae70562140: start","job_status":"start","queue_duration_s":0.202142,"scheduling_latency_s":0.202155}1584gitlab # [ 177.282134] gitaly[1356]: time="2026-07-25T09:41:09.899Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:41:19.108" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.899" pid=1356 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1585gitlab # [ 177.282783] gitaly[1356]: time="2026-07-25T09:41:09.899Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:41:19.108" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.899" grpc.time_ms=0.354 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1586gitlab # [ 177.283408] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97591b0075aa75ae70562140","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97591b0075aa75ae70562140: done: 0.00869 sec","job_status":"done","queue_duration_s":0.202142,"scheduling_latency_s":0.202155,"redis_calls":13,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00869,"completed_at":"2026-07-25T09:41:09.115Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 177.308582] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"194ef4351eb38f4f8dea1f8f","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-194ef4351eb38f4f8dea1f8f: start","job_status":"start","queue_duration_s":0.211639,"scheduling_latency_s":0.211652}1588gitlab # [ 177.318815] gitaly[1356]: time="2026-07-25T09:41:09.906Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T09:41:19.111" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.901" grpc.time_ms=4.96 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1589gitlab # [ 177.360101] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"194ef4351eb38f4f8dea1f8f","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-194ef4351eb38f4f8dea1f8f: done: 0.008672 sec","job_status":"done","queue_duration_s":0.211639,"scheduling_latency_s":0.211652,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008672,"completed_at":"2026-07-25T09:41:09.124Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1590gitlab # [ 177.399199] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c59f9e9826b1a7a49f9e74a8","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c59f9e9826b1a7a49f9e74a8: start","job_status":"start","queue_duration_s":0.221086,"scheduling_latency_s":0.221098}1591gitlab # [ 177.400226] gitaly[1356]: time="2026-07-25T09:41:09.936Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:41:19.145" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.935" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 177.400830] gitaly[1356]: time="2026-07-25T09:41:09.936Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:41:19.145" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.935" grpc.time_ms=0.173 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 177.401401] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c59f9e9826b1a7a49f9e74a8","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c59f9e9826b1a7a49f9e74a8: done: 0.00863 sec","job_status":"done","queue_duration_s":0.221086,"scheduling_latency_s":0.221098,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00863,"completed_at":"2026-07-25T09:41:09.134Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1594gitlab # [ 177.446722] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a34058e96c5dc1450365fe0","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a34058e96c5dc1450365fe0: start","job_status":"start","queue_duration_s":0.230527,"scheduling_latency_s":0.23054}1595gitlab # [ 177.447670] gitaly[1356]: time="2026-07-25T09:41:09.972Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y diskcache=76f6eb02-ac77-43e7-aebc-a6203d06497a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-25T09:41:19.148" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.939" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 177.449525] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a34058e96c5dc1450365fe0","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a34058e96c5dc1450365fe0: done: 0.008552 sec","job_status":"done","queue_duration_s":0.230527,"scheduling_latency_s":0.23054,"redis_calls":13,"redis_duration_s":0.001501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008552,"completed_at":"2026-07-25T09:41:09.143Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 177.494229] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a45547ca1032a4a8b3f29ba","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a45547ca1032a4a8b3f29ba: start","job_status":"start","queue_duration_s":0.239886,"scheduling_latency_s":0.2399}1598gitlab # [ 177.494943] gitaly[1356]: time="2026-07-25T09:41:09.972Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=326 command.oublock=32 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-25T09:41:19.148" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.939" grpc.time_ms=33.001 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1599gitlab # [ 177.542529] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a45547ca1032a4a8b3f29ba","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a45547ca1032a4a8b3f29ba: done: 0.009305 sec","job_status":"done","queue_duration_s":0.239886,"scheduling_latency_s":0.2399,"redis_calls":13,"redis_duration_s":0.0021650000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000655,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009305,"completed_at":"2026-07-25T09:41:09.153Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1600gitlab # [ 177.543736] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af1950bf82d666ec48b600bc","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af1950bf82d666ec48b600bc: start","job_status":"start","queue_duration_s":0.250147,"scheduling_latency_s":0.25016}1601gitlab # [ 177.552744] gitaly[1356]: time="2026-07-25T09:41:09.976Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:41:19.186" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.976" pid=1356 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1602gitlab # [ 177.562183] gitaly[1356]: time="2026-07-25T09:41:09.977Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:41:19.186" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.976" grpc.time_ms=0.386 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1603gitlab # [ 177.600549] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af1950bf82d666ec48b600bc","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af1950bf82d666ec48b600bc: done: 0.009372 sec","job_status":"done","queue_duration_s":0.250147,"scheduling_latency_s":0.25016,"redis_calls":13,"redis_duration_s":0.002188,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001458,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009372,"completed_at":"2026-07-25T09:41:09.164Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1604gitlab # [ 177.606745] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c72dc31db1eb7233af1dfc0","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c72dc31db1eb7233af1dfc0: start","job_status":"start","queue_duration_s":0.260467,"scheduling_latency_s":0.26048}1605gitlab # [ 177.649828] gitaly[1356]: time="2026-07-25T09:41:09.986Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T09:41:19.190" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:09.981" grpc.time_ms=4.936 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1606gitlab # [ 177.650670] setup-gitlab-start[2559]: + mkdir -p /tmp/test-flake1607gitlab # [ 177.651160] setup-gitlab-start[2559]: + cd /tmp/test-flake1608gitlab # [ 177.651471] setup-gitlab-start[2559]: + git init -b master1609gitlab # [ 177.651969] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c72dc31db1eb7233af1dfc0","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c72dc31db1eb7233af1dfc0: done: 0.009479 sec","job_status":"done","queue_duration_s":0.260467,"scheduling_latency_s":0.26048,"redis_calls":13,"redis_duration_s":0.002333,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001619,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009479,"completed_at":"2026-07-25T09:41:09.174Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1610gitlab # [ 177.704827] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b84d3f4dd85e4203943fda1","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b84d3f4dd85e4203943fda1: start","job_status":"start","queue_duration_s":0.270892,"scheduling_latency_s":0.270904}1611gitlab # [ 177.706121] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:10 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 10011612gitlab # [ 177.706599] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:10 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 241613gitlab # [ 177.707149] gitaly[1356]: time="2026-07-25T09:41:10.006Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:41:20.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:10.006" grpc.time_ms=0.103 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1614gitlab # [ 177.707668] gitaly[1356]: time="2026-07-25T09:41:10.011Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-25T09:41:20.010" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:10.010" grpc.time_ms=0.267 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 177.708293] setup-gitlab-start[2859]: Initialized empty Git repository in /tmp/test-flake/.git/1616gitlab # [ 177.708897] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b84d3f4dd85e4203943fda1","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b84d3f4dd85e4203943fda1: done: 0.009462 sec","job_status":"done","queue_duration_s":0.270892,"scheduling_latency_s":0.270904,"redis_calls":13,"redis_duration_s":0.002161,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000689,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001472,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009462,"completed_at":"2026-07-25T09:41:09.184Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 177.772991] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ce2de21239f20d0f0944d13","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ce2de21239f20d0f0944d13: start","job_status":"start","queue_duration_s":0.281282,"scheduling_latency_s":0.281295}1618gitlab # [ 177.773812] gitaly[1356]: time="2026-07-25T09:41:10.164Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACS6RR5QZK3GN8T8G9K3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T09:41:20.157" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:10.158" grpc.time_ms=5.804 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619gitlab # [ 177.774956] setup-gitlab-start[2559]: + git config user.name test1620gitlab # [ 177.775695] setup-gitlab-start[2559]: + git config user.email test@example.com1621gitlab # [ 177.776207] setup-gitlab-start[2559]: + cat1622gitlab # [ 177.776718] setup-gitlab-start[2559]: + git add flake.nix1623gitlab # [ 177.777417] setup-gitlab-start[2559]: + git commit -m 'initial commit'1624gitlab # [ 177.778032] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ce2de21239f20d0f0944d13","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ce2de21239f20d0f0944d13: done: 0.009289 sec","job_status":"done","queue_duration_s":0.281282,"scheduling_latency_s":0.281295,"redis_calls":13,"redis_duration_s":0.00215,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001456,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009289,"completed_at":"2026-07-25T09:41:09.195Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 177.827709] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1da83e271f2d370077a8e00a","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1da83e271f2d370077a8e00a: start","job_status":"start","queue_duration_s":0.29151,"scheduling_latency_s":0.291524}1626gitlab # [ 177.828640] setup-gitlab-start[2864]: [master (root-commit) 1cad3f8] initial commit1627gitlab # [ 177.829211] setup-gitlab-start[2864]: 1 file changed, 10 insertions(+)1628gitlab # [ 177.829706] setup-gitlab-start[2864]: create mode 100644 flake.nix1629gitlab # [ 177.830473] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1da83e271f2d370077a8e00a","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1da83e271f2d370077a8e00a: done: 0.009364 sec","job_status":"done","queue_duration_s":0.29151,"scheduling_latency_s":0.291524,"redis_calls":13,"redis_duration_s":0.002234,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001503,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009364,"completed_at":"2026-07-25T09:41:09.205Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630gitlab # [ 177.864648] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8690bb705beab6c0df6b219c","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8690bb705beab6c0df6b219c: start","job_status":"start","queue_duration_s":0.301817,"scheduling_latency_s":0.30183}1631gitlab # [ 177.910580] setup-gitlab-start[2559]: + git remote add origin http://oauth2:glpat-aL7yM8l67Mgn4Eg7PVptXm86MQp1OjEH.01.0w0jelon5@gitlab/root/test-flake.git1632gitlab # [ 177.911455] setup-gitlab-start[2559]: + git push -u origin master1633gitlab # [ 177.912212] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:10 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 1811634gitlab # [ 177.912740] gitaly[1356]: time="2026-07-25T09:41:10.730Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACT8N91BW1BXYRNCY9W0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:10.723" grpc.time_ms=6.599 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1635gitlab # [ 177.913613] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8690bb705beab6c0df6b219c","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8690bb705beab6c0df6b219c: done: 0.00888 sec","job_status":"done","queue_duration_s":0.301817,"scheduling_latency_s":0.30183,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00888,"completed_at":"2026-07-25T09:41:09.215Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636gitlab # [ 177.971158] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17894ce7cbc69903ae013f66","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17894ce7cbc69903ae013f66: start","job_status":"start","queue_duration_s":0.311532,"scheduling_latency_s":0.311546}1637gitlab # [ 177.971983] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17894ce7cbc69903ae013f66","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17894ce7cbc69903ae013f66: done: 0.008563 sec","job_status":"done","queue_duration_s":0.311532,"scheduling_latency_s":0.311546,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008563,"completed_at":"2026-07-25T09:41:09.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1638gitlab # [ 178.013847] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b42b5691ab1540d4a5b40fe9","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b42b5691ab1540d4a5b40fe9: start","job_status":"start","queue_duration_s":0.320899,"scheduling_latency_s":0.320912}1639gitlab # [ 178.014722] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b42b5691ab1540d4a5b40fe9","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b42b5691ab1540d4a5b40fe9: done: 0.013803 sec","job_status":"done","queue_duration_s":0.320899,"scheduling_latency_s":0.320912,"redis_calls":13,"redis_duration_s":0.002556,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001634,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013803,"completed_at":"2026-07-25T09:41:09.239Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1640gitlab # [ 178.031556] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"443da3f5dfc2d7d4268805e9","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-443da3f5dfc2d7d4268805e9: start","job_status":"start","queue_duration_s":0.335982,"scheduling_latency_s":0.336002}1641gitlab # [ 178.077884] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"443da3f5dfc2d7d4268805e9","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-443da3f5dfc2d7d4268805e9: done: 0.010665 sec","job_status":"done","queue_duration_s":0.335982,"scheduling_latency_s":0.336002,"redis_calls":13,"redis_duration_s":0.002757,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001771,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010665,"completed_at":"2026-07-25T09:41:09.251Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1642gitlab # [ 178.080695] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"877f73bddca7bb58a490462f","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-877f73bddca7bb58a490462f: start","job_status":"start","queue_duration_s":0.34788,"scheduling_latency_s":0.347897}1643gitlab # [ 178.125359] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"877f73bddca7bb58a490462f","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-877f73bddca7bb58a490462f: done: 0.010682 sec","job_status":"done","queue_duration_s":0.34788,"scheduling_latency_s":0.347897,"redis_calls":13,"redis_duration_s":0.002592,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001775,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010682,"completed_at":"2026-07-25T09:41:09.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644gitlab # [ 178.130532] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f471359588a7bcfb4979e6de","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f471359588a7bcfb4979e6de: start","job_status":"start","queue_duration_s":0.359668,"scheduling_latency_s":0.359681}1645gitlab # [ 178.173880] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f471359588a7bcfb4979e6de","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f471359588a7bcfb4979e6de: done: 0.010257 sec","job_status":"done","queue_duration_s":0.359668,"scheduling_latency_s":0.359681,"redis_calls":13,"redis_duration_s":0.002979,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001856,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010257,"completed_at":"2026-07-25T09:41:09.274Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646gitlab # [ 178.179874] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4147f55bb0948e8533129c7c","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4147f55bb0948e8533129c7c: start","job_status":"start","queue_duration_s":0.370959,"scheduling_latency_s":0.370972}1647gitlab # [ 178.231060] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4147f55bb0948e8533129c7c","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4147f55bb0948e8533129c7c: done: 0.022896 sec","job_status":"done","queue_duration_s":0.370959,"scheduling_latency_s":0.370972,"redis_calls":13,"redis_duration_s":0.003922999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001219,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002704,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022896,"completed_at":"2026-07-25T09:41:09.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648gitlab # [ 178.232111] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"177a7b64f0a257ae259e06c4","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-177a7b64f0a257ae259e06c4: start","job_status":"start","queue_duration_s":0.395605,"scheduling_latency_s":0.395633}1649gitlab # [ 178.241928] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"177a7b64f0a257ae259e06c4","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-177a7b64f0a257ae259e06c4: done: 0.015963 sec","job_status":"done","queue_duration_s":0.395605,"scheduling_latency_s":0.395633,"redis_calls":13,"redis_duration_s":0.002466,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001695,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015963,"completed_at":"2026-07-25T09:41:09.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650gitlab # [ 178.301180] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1dc0628966f5eb4b5a50a1c","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1dc0628966f5eb4b5a50a1c: start","job_status":"start","queue_duration_s":0.41237,"scheduling_latency_s":0.412383}1651gitlab # [ 178.301450] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1dc0628966f5eb4b5a50a1c","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1dc0628966f5eb4b5a50a1c: done: 0.008621 sec","job_status":"done","queue_duration_s":0.41237,"scheduling_latency_s":0.412383,"redis_calls":13,"redis_duration_s":0.001515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008621,"completed_at":"2026-07-25T09:41:09.325Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652gitlab # [ 178.330482] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ad55423e9f4e7ab7f21f674","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ad55423e9f4e7ab7f21f674: start","job_status":"start","queue_duration_s":0.421805,"scheduling_latency_s":0.421818}1653gitlab # [ 178.383175] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ad55423e9f4e7ab7f21f674","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ad55423e9f4e7ab7f21f674: done: 0.008509 sec","job_status":"done","queue_duration_s":0.421805,"scheduling_latency_s":0.421818,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008509,"completed_at":"2026-07-25T09:41:09.334Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654gitlab # [ 178.384276] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8d659331bb813dc2359787d","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8d659331bb813dc2359787d: start","job_status":"start","queue_duration_s":0.431577,"scheduling_latency_s":0.43159}1655gitlab # [ 178.429753] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8d659331bb813dc2359787d","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8d659331bb813dc2359787d: done: 0.008745 sec","job_status":"done","queue_duration_s":0.431577,"scheduling_latency_s":0.43159,"redis_calls":13,"redis_duration_s":0.001593,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008745,"completed_at":"2026-07-25T09:41:09.344Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656gitlab # [ 178.431049] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad09730d6cc90ca71d313e41","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad09730d6cc90ca71d313e41: start","job_status":"start","queue_duration_s":0.441121,"scheduling_latency_s":0.441134}1657gitlab # [ 178.477115] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad09730d6cc90ca71d313e41","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad09730d6cc90ca71d313e41: done: 0.008627 sec","job_status":"done","queue_duration_s":0.441121,"scheduling_latency_s":0.441134,"redis_calls":13,"redis_duration_s":0.0015240000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008627,"completed_at":"2026-07-25T09:41:09.354Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658gitlab # [ 178.479473] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"802f15a00f51c989c2e969f0","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-802f15a00f51c989c2e969f0: start","job_status":"start","queue_duration_s":0.450568,"scheduling_latency_s":0.450581}1659gitlab # [ 178.491739] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"802f15a00f51c989c2e969f0","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-802f15a00f51c989c2e969f0: done: 0.008787 sec","job_status":"done","queue_duration_s":0.450568,"scheduling_latency_s":0.450581,"redis_calls":13,"redis_duration_s":0.0016589999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008787,"completed_at":"2026-07-25T09:41:09.363Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660gitlab # [ 178.565174] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30d0fed5bb4394560e258cb8","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30d0fed5bb4394560e258cb8: start","job_status":"start","queue_duration_s":0.46082,"scheduling_latency_s":0.460833}1661gitlab # [ 178.565961] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30d0fed5bb4394560e258cb8","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30d0fed5bb4394560e258cb8: done: 0.008979 sec","job_status":"done","queue_duration_s":0.46082,"scheduling_latency_s":0.460833,"redis_calls":13,"redis_duration_s":0.0017779999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008979,"completed_at":"2026-07-25T09:41:09.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1662gitlab # [ 178.607920] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7676e6d7f86db25bc4b9cdf1","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7676e6d7f86db25bc4b9cdf1: start","job_status":"start","queue_duration_s":0.470675,"scheduling_latency_s":0.470689}1663gitlab # [ 178.608715] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7676e6d7f86db25bc4b9cdf1","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7676e6d7f86db25bc4b9cdf1: done: 0.008725 sec","job_status":"done","queue_duration_s":0.470675,"scheduling_latency_s":0.470689,"redis_calls":13,"redis_duration_s":0.001621,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008725,"completed_at":"2026-07-25T09:41:09.383Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664gitlab # [ 178.652717] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db5e95aa285e165f39f13f68","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db5e95aa285e165f39f13f68: start","job_status":"start","queue_duration_s":0.480237,"scheduling_latency_s":0.480256}1665gitlab # [ 178.653562] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db5e95aa285e165f39f13f68","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db5e95aa285e165f39f13f68: done: 0.008806 sec","job_status":"done","queue_duration_s":0.480237,"scheduling_latency_s":0.480256,"redis_calls":13,"redis_duration_s":0.001642,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008806,"completed_at":"2026-07-25T09:41:09.393Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666gitlab # [ 178.713802] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0fad91f506ab9f671dc968f","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0fad91f506ab9f671dc968f: start","job_status":"start","queue_duration_s":0.489842,"scheduling_latency_s":0.489856}1667gitlab # [ 178.714428] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0fad91f506ab9f671dc968f","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0fad91f506ab9f671dc968f: done: 0.011176 sec","job_status":"done","queue_duration_s":0.489842,"scheduling_latency_s":0.489856,"redis_calls":13,"redis_duration_s":0.001803,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000617,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011176,"completed_at":"2026-07-25T09:41:09.405Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668gitlab # [ 178.728498] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8ac623189313cfa1f0f8370","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8ac623189313cfa1f0f8370: start","job_status":"start","queue_duration_s":0.502024,"scheduling_latency_s":0.502044}1669gitlab # [ 178.740617] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8ac623189313cfa1f0f8370","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8ac623189313cfa1f0f8370: done: 0.00908 sec","job_status":"done","queue_duration_s":0.502024,"scheduling_latency_s":0.502044,"redis_calls":13,"redis_duration_s":0.001592,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00908,"completed_at":"2026-07-25T09:41:09.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 178.796156] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2576cd9f1c1c85b7ce3d81c","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2576cd9f1c1c85b7ce3d81c: start","job_status":"start","queue_duration_s":0.51191,"scheduling_latency_s":0.511922}1671gitlab # [ 178.796982] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2576cd9f1c1c85b7ce3d81c","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2576cd9f1c1c85b7ce3d81c: done: 0.012105 sec","job_status":"done","queue_duration_s":0.51191,"scheduling_latency_s":0.511922,"redis_calls":13,"redis_duration_s":0.0025529999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001339,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001214,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012105,"completed_at":"2026-07-25T09:41:09.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1672gitlab # [ 178.851149] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.429Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"1ff595bd68f1460d6adfc6e2","created_at":"2026-07-25T09:41:09.406Z","trace_propagation_headers":{"sentry-trace":"f7ceec03905148c2a9155e18ed504082-13e7a8e173c9410d","baggage":"sentry-trace_id=f7ceec03905148c2a9155e18ed504082,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACRB3WRSQ47ZF3XB9J7HW","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:001d7cedc1874b46aafef63ccb0b8f044c8139a9fa086c6b0145b752fda84087","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:09.424Z","job_size_bytes":451,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-1ff595bd68f1460d6adfc6e2: start","job_status":"start","queue_duration_s":0.004884,"scheduling_latency_s":0.004904}1673gitlab # [ 178.852078] sidekiq-cluster[2048]: {"severity":"WARN","time":"2026-07-25T09:41:09.519Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"1ff595bd68f1460d6adfc6e2","created_at":"2026-07-25T09:41:09.406Z","trace_propagation_headers":{"sentry-trace":"f7ceec03905148c2a9155e18ed504082-13e7a8e173c9410d","baggage":"sentry-trace_id=f7ceec03905148c2a9155e18ed504082,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACRB3WRSQ47ZF3XB9J7HW","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:001d7cedc1874b46aafef63ccb0b8f044c8139a9fa086c6b0145b752fda84087","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:09.424Z","job_size_bytes":451,"pid":2048,"sidekiq_tid":"lypc","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-1ff595bd68f1460d6adfc6e2: fail: 0.089532 sec","job_status":"fail","queue_duration_s":0.004884,"scheduling_latency_s":0.004904,"redis_calls":11,"redis_duration_s":0.001606,"redis_read_bytes":137,"redis_write_bytes":1317,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000412,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021539,"duration_s":0.089532,"completed_at":"2026-07-25T09:41:09.519Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.032185,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1674gitlab # [ 179.238624] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09af4c58bb651a891dd6e354","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09af4c58bb651a891dd6e354: start","job_status":"start","queue_duration_s":0.618298,"scheduling_latency_s":0.618325}1675gitlab # [ 179.239263] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09af4c58bb651a891dd6e354","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09af4c58bb651a891dd6e354: done: 0.020294 sec","job_status":"done","queue_duration_s":0.618298,"scheduling_latency_s":0.618325,"redis_calls":13,"redis_duration_s":0.009436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001397,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020294,"completed_at":"2026-07-25T09:41:09.543Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1676gitlab # [ 179.258662] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eae47d30fa17fca06b9dbfa7","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eae47d30fa17fca06b9dbfa7: start","job_status":"start","queue_duration_s":0.642427,"scheduling_latency_s":0.642458}1677gitlab # [ 179.303792] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eae47d30fa17fca06b9dbfa7","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eae47d30fa17fca06b9dbfa7: done: 0.011467 sec","job_status":"done","queue_duration_s":0.642427,"scheduling_latency_s":0.642458,"redis_calls":13,"redis_duration_s":0.001576,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011467,"completed_at":"2026-07-25T09:41:09.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1678gitlab # [ 179.307882] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c442e3999f20655fee1177c0","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c442e3999f20655fee1177c0: start","job_status":"start","queue_duration_s":0.654669,"scheduling_latency_s":0.654683}1679gitlab # [ 179.351137] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c442e3999f20655fee1177c0","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c442e3999f20655fee1177c0: done: 0.009538 sec","job_status":"done","queue_duration_s":0.654669,"scheduling_latency_s":0.654683,"redis_calls":13,"redis_duration_s":0.001541,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009538,"completed_at":"2026-07-25T09:41:09.568Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1680gitlab # [ 179.397032] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f0bdce9dce9c11d5b149f5a","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f0bdce9dce9c11d5b149f5a: start","job_status":"start","queue_duration_s":0.66502,"scheduling_latency_s":0.665033}1681gitlab # [ 179.397749] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f0bdce9dce9c11d5b149f5a","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f0bdce9dce9c11d5b149f5a: done: 0.008815 sec","job_status":"done","queue_duration_s":0.66502,"scheduling_latency_s":0.665033,"redis_calls":13,"redis_duration_s":0.001619,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008815,"completed_at":"2026-07-25T09:41:09.578Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1682gitlab # [ 179.406899] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1b837d8dc24e56da6ef1c54","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1b837d8dc24e56da6ef1c54: start","job_status":"start","queue_duration_s":0.674639,"scheduling_latency_s":0.674655}1683gitlab # [ 179.419072] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1b837d8dc24e56da6ef1c54","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1b837d8dc24e56da6ef1c54: done: 0.008517 sec","job_status":"done","queue_duration_s":0.674639,"scheduling_latency_s":0.674655,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008517,"completed_at":"2026-07-25T09:41:09.587Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1684gitlab # [ 179.475202] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8a35c8b2c8f8527415806c1","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8a35c8b2c8f8527415806c1: start","job_status":"start","queue_duration_s":0.683945,"scheduling_latency_s":0.683957}1685gitlab # [ 179.475960] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8a35c8b2c8f8527415806c1","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8a35c8b2c8f8527415806c1: done: 0.008828 sec","job_status":"done","queue_duration_s":0.683945,"scheduling_latency_s":0.683957,"redis_calls":13,"redis_duration_s":0.0017009999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008828,"completed_at":"2026-07-25T09:41:09.597Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1686gitlab # [ 179.519839] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb1a26509e284d65d3d77cc8","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb1a26509e284d65d3d77cc8: start","job_status":"start","queue_duration_s":0.693598,"scheduling_latency_s":0.693612}1687gitlab # [ 179.520640] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb1a26509e284d65d3d77cc8","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb1a26509e284d65d3d77cc8: done: 0.008936 sec","job_status":"done","queue_duration_s":0.693598,"scheduling_latency_s":0.693612,"redis_calls":13,"redis_duration_s":0.001754,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000607,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008936,"completed_at":"2026-07-25T09:41:09.607Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1688gitlab # [ 179.565126] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4078e57a8311dde9c267cace","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4078e57a8311dde9c267cace: start","job_status":"start","queue_duration_s":0.703438,"scheduling_latency_s":0.703452}1689gitlab # [ 179.567964] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4078e57a8311dde9c267cace","created_at":"2026-07-25T09:41:08.865Z","trace_propagation_headers":{"sentry-trace":"5308627c5bd04a1d827c99ff0e0ba921-06ec4fa43c9649dc","baggage":"sentry-trace_id=5308627c5bd04a1d827c99ff0e0ba921,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba0b413e8a569cb37cbf63ef698c7dc7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:08.904Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4078e57a8311dde9c267cace: done: 0.010843 sec","job_status":"done","queue_duration_s":0.703438,"scheduling_latency_s":0.703452,"redis_calls":13,"redis_duration_s":0.0018739999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001323,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010843,"completed_at":"2026-07-25T09:41:09.618Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1690gitlab # [ 179.614254] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.921Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"92d13a0d753b45572078ba0b","created_at":"2026-07-25T09:41:09.912Z","trace_propagation_headers":{"sentry-trace":"06f09cdfafb04cbd8e1fa7f17afc96f3-5e77e4a2c6024646","baggage":"sentry-trace_id=06f09cdfafb04cbd8e1fa7f17afc96f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACS6RR5QZK3GN8T8G9K3Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:09.917Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-92d13a0d753b45572078ba0b: start","job_status":"start","queue_duration_s":0.004074,"scheduling_latency_s":0.004102}1691gitlab # [ 179.619901] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.960Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"92d13a0d753b45572078ba0b","created_at":"2026-07-25T09:41:09.912Z","trace_propagation_headers":{"sentry-trace":"06f09cdfafb04cbd8e1fa7f17afc96f3-5e77e4a2c6024646","baggage":"sentry-trace_id=06f09cdfafb04cbd8e1fa7f17afc96f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACS6RR5QZK3GN8T8G9K3Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:09.917Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-92d13a0d753b45572078ba0b: done: 0.039026 sec","job_status":"done","queue_duration_s":0.004074,"scheduling_latency_s":0.004102,"redis_calls":10,"redis_duration_s":0.0040219999999999995,"redis_read_bytes":8,"redis_write_bytes":1165,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001209,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002813,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":7,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.021722593,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.039026,"completed_at":"2026-07-25T09:41:09.960Z","load_balancing_strategy":"primary","db_duration_s":0.006846,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1692gitlab # [ 179.677087] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:09.961Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"b3f5d992d3d63a0b8759631b","created_at":"2026-07-25T09:41:09.928Z","trace_propagation_headers":{"sentry-trace":"06f09cdfafb04cbd8e1fa7f17afc96f3-5e77e4a2c6024646","baggage":"sentry-trace_id=06f09cdfafb04cbd8e1fa7f17afc96f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACS6RR5QZK3GN8T8G9K3Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:09.932Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-b3f5d992d3d63a0b8759631b: start","job_status":"start","queue_duration_s":0.029198,"scheduling_latency_s":0.029216}1693gitlab # [ 179.677875] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:10.027Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"b3f5d992d3d63a0b8759631b","created_at":"2026-07-25T09:41:09.928Z","trace_propagation_headers":{"sentry-trace":"06f09cdfafb04cbd8e1fa7f17afc96f3-5e77e4a2c6024646","baggage":"sentry-trace_id=06f09cdfafb04cbd8e1fa7f17afc96f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACS6RR5QZK3GN8T8G9K3Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:09.932Z","job_size_bytes":2,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-b3f5d992d3d63a0b8759631b: done: 0.06657 sec","job_status":"done","queue_duration_s":0.029198,"scheduling_latency_s":0.029216,"redis_calls":14,"redis_duration_s":0.002186,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000463,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001072,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000651,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.050075358,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.06657,"completed_at":"2026-07-25T09:41:10.027Z","load_balancing_strategy":"primary","db_duration_s":0.014186,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1694gitlab # [ 179.729845] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:10.121Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2106078f272f952974aa8fe8","created_at":"2026-07-25T09:41:10.116Z","trace_propagation_headers":{"sentry-trace":"06f09cdfafb04cbd8e1fa7f17afc96f3-5e77e4a2c6024646","baggage":"sentry-trace_id=06f09cdfafb04cbd8e1fa7f17afc96f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACS6RR5QZK3GN8T8G9K3Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:10.120Z","job_size_bytes":5,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2106078f272f952974aa8fe8: start","job_status":"start","queue_duration_s":0.001113,"scheduling_latency_s":0.001144}1695gitlab # [ 179.774792] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:10.192Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2106078f272f952974aa8fe8","created_at":"2026-07-25T09:41:10.116Z","trace_propagation_headers":{"sentry-trace":"06f09cdfafb04cbd8e1fa7f17afc96f3-5e77e4a2c6024646","baggage":"sentry-trace_id=06f09cdfafb04cbd8e1fa7f17afc96f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACS6RR5QZK3GN8T8G9K3Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:10.120Z","job_size_bytes":5,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2106078f272f952974aa8fe8: done: 0.070959 sec","job_status":"done","queue_duration_s":0.001113,"scheduling_latency_s":0.001144,"redis_calls":12,"redis_duration_s":0.001742,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.0005,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205334,"duration_s":0.070959,"completed_at":"2026-07-25T09:41:10.192Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015223,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1696gitlab # [ 179.816769] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:10.193Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"ac3a30d9bdc068f9c894eed1","created_at":"2026-07-25T09:41:10.137Z","trace_propagation_headers":{"sentry-trace":"06f09cdfafb04cbd8e1fa7f17afc96f3-5e77e4a2c6024646","baggage":"sentry-trace_id=06f09cdfafb04cbd8e1fa7f17afc96f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACS6RR5QZK3GN8T8G9K3Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:10.140Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-ac3a30d9bdc068f9c894eed1: start","job_status":"start","queue_duration_s":0.052403,"scheduling_latency_s":0.052417}1697gitlab # [ 179.817668] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:10.348Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"ac3a30d9bdc068f9c894eed1","created_at":"2026-07-25T09:41:10.137Z","trace_propagation_headers":{"sentry-trace":"06f09cdfafb04cbd8e1fa7f17afc96f3-5e77e4a2c6024646","baggage":"sentry-trace_id=06f09cdfafb04cbd8e1fa7f17afc96f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACS6RR5QZK3GN8T8G9K3Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:10.140Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-ac3a30d9bdc068f9c894eed1: done: 0.155514 sec","job_status":"done","queue_duration_s":0.052403,"scheduling_latency_s":0.052417,"redis_calls":11,"redis_duration_s":0.001607,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000408,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.135,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.135,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198908,"duration_s":0.155514,"completed_at":"2026-07-25T09:41:10.348Z","load_balancing_strategy":"primary","db_duration_s":0.039441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1698gitlab # [ 179.860735] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:10.349Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"18f674b6215b98ab78baac45","created_at":"2026-07-25T09:41:10.142Z","trace_propagation_headers":{"sentry-trace":"06f09cdfafb04cbd8e1fa7f17afc96f3-5e77e4a2c6024646","baggage":"sentry-trace_id=06f09cdfafb04cbd8e1fa7f17afc96f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACS6RR5QZK3GN8T8G9K3Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:10.145Z","job_size_bytes":89,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-18f674b6215b98ab78baac45: start","job_status":"start","queue_duration_s":0.204311,"scheduling_latency_s":0.204334}1699gitlab # [ 179.861674] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:10.391Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"18f674b6215b98ab78baac45","created_at":"2026-07-25T09:41:10.142Z","trace_propagation_headers":{"sentry-trace":"06f09cdfafb04cbd8e1fa7f17afc96f3-5e77e4a2c6024646","baggage":"sentry-trace_id=06f09cdfafb04cbd8e1fa7f17afc96f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACS6RR5QZK3GN8T8G9K3Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:10.145Z","job_size_bytes":89,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-18f674b6215b98ab78baac45: done: 0.041294 sec","job_status":"done","queue_duration_s":0.204311,"scheduling_latency_s":0.204334,"redis_calls":11,"redis_duration_s":0.001498,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000419,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000792,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205892,"duration_s":0.041294,"completed_at":"2026-07-25T09:41:10.391Z","load_balancing_strategy":"primary","db_duration_s":0.015575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1700gitlab # [ 180.018908] gitaly[1356]: time="2026-07-25T09:41:12.882Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T09:41:22.086" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:12.877" grpc.time_ms=4.941 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1701gitlab # [ 180.044233] gitaly[1356]: time="2026-07-25T09:41:12.907Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-25T09:41:42.097" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-25T09:41:12.898" grpc.time_ms=9.624 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1702gitlab # [ 180.056161] gitaly[1356]: time="2026-07-25T09:41:12.919Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 duration_ms=94ns method=POST pid=1356 status=200 url="http://unix/api/v4/internal/allowed"1703gitlab # [ 180.075317] gitaly[1356]: time="2026-07-25T09:41:12.939Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 duration_ms=17ns method=POST pid=1356 status=200 url="http://unix/api/v4/internal/pre_receive"1704gitlab # [ 180.077224] gitaly[1356]: time="2026-07-25T09:41:12.940Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5321 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:12.825" grpc.time_ms=114.838 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1705gitlab # [ 180.105235] gitaly[1356]: time="2026-07-25T09:41:12.968Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:12.968" grpc.time_ms=0.504 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1706gitlab # [ 180.141191] gitaly[1356]: time="2026-07-25T09:41:13.004Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4790 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:13.003" grpc.time_ms=0.585 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1707gitlab # [ 180.170623] gitaly[1356]: time="2026-07-25T09:41:13.034Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:13.033" grpc.time_ms=0.334 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1708gitlab # [ 180.256417] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:13.119Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 1cad3f8dcab61599d4be7caef6e24d4ed336656d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"bd99f59a04422cdf714c50e7","created_at":"2026-07-25T09:41:13.099Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-4bac22c9ee5845b2","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:13.116Z","job_size_bytes":185,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-bd99f59a04422cdf714c50e7: start","job_status":"start","queue_duration_s":0.002584,"scheduling_latency_s":0.002613}1709gitlab # [ 180.269169] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:13.132Z","message":"changes: \"0000000000000000000000000000000000000000 1cad3f8dcab61599d4be7caef6e24d4ed336656d refs/heads/master\\n\""}1710gitlab # [ 180.303594] gitaly[1356]: time="2026-07-25T09:41:13.167Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T09:41:23.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:13.160" grpc.time_ms=6.972 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1711gitlab # [ 180.322112] gitaly[1356]: time="2026-07-25T09:41:13.185Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:23.030" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:13.180" grpc.time_ms=4.761 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1712gitlab # [ 180.341092] gitaly[1356]: time="2026-07-25T09:41:13.204Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1567 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=6 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-25T09:41:23.040" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:13.190" grpc.time_ms=14.192 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1713gitlab # [ 180.360643] gitaly[1356]: time="2026-07-25T09:41:13.224Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1558 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-25T09:41:23.001" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:13.211" grpc.time_ms=12.567 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1714gitlab # [ 180.375365] gitaly[1356]: time="2026-07-25T09:41:13.236Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 duration_ms=174ns method=POST pid=1356 status=200 url="http://unix/api/v4/internal/post_receive"1715gitlab # [ 180.379873] gitaly[1356]: time="2026-07-25T09:41:13.236Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4815 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:13.061" grpc.time_ms=175.623 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1716gitlab # [ 180.391300] gitaly[1356]: time="2026-07-25T09:41:13.253Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 diskcache=8c6ccb51-1aa9-4fd8-9ea4-4c4de087bef8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:10.783" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1717gitlab # [ 180.391876] gitlab-workhorse[1288]: time="2026-07-25T09:41:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521718gitlab # [ 180.392638] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:13 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 25161719gitlab # [ 180.393443] setup-gitlab-start[2868]: To http://gitlab/root/test-flake.git1720gitlab # [ 180.393907] setup-gitlab-start[2868]: * [new branch] master -> master1721gitlab # [ 180.394573] gitaly[1356]: time="2026-07-25T09:41:13.253Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=136 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13406 command.oublock=32 command.real_time_ms=2459 command.spawn_token_fork_ms=0 command.system_time_ms=86 command.user_time_ms=50 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:10.783" grpc.time_ms=2470.334 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1722gitlab # [ 180.395483] setup-gitlab-start[2868]: branch 'master' set up to track 'origin/master'.1723gitlab # [ 180.421325] systemd[1]: Finished setup-gitlab.service.1724gitlab # [ 180.423864] systemd[1]: Starting nixbot CI service...1725gitlab # [ 180.500237] gitaly[1356]: time="2026-07-25T09:41:13.363Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-25T09:41:23.206" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:13.357" grpc.time_ms=6.695 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1726gitlab # [ 180.566450] gitaly[1356]: time="2026-07-25T09:41:13.430Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3941 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:13.429" grpc.time_ms=0.349 pid=1356 span.kind=server system=grpc1727gitlab # [ 180.595878] gitaly[1356]: time="2026-07-25T09:41:13.459Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3943 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:13.458" grpc.time_ms=0.646 pid=1356 span.kind=server system=grpc1728gitlab # [ 180.613413] gitaly[1356]: time="2026-07-25T09:41:13.477Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 diskcache=66d90c39-b579-49bc-b810-f0bd3a68d95d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T09:41:23.259" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:13.410" pid=1356 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1729gitlab # [ 180.613833] gitaly[1356]: time="2026-07-25T09:41:13.477Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=51 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4849 command.oublock=8 command.real_time_ms=60 command.spawn_token_fork_ms=0 command.system_time_ms=28 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T09:41:23.259" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:13.410" grpc.time_ms=66.935 pid=1356 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1730gitlab # [ 180.637625] gitaly[1356]: time="2026-07-25T09:41:13.501Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T09:41:23.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:13.501" grpc.time_ms=0.134 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1731gitlab # [ 180.650069] gitaly[1356]: time="2026-07-25T09:41:13.513Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=943 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-25T09:41:23.016" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:13.506" grpc.time_ms=6.865 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1732gitlab # [ 180.732032] gitaly[1356]: time="2026-07-25T09:41:13.595Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-07-25T09:41:43.091" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:13.591" grpc.time_ms=4.195 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1733gitlab # [ 180.769801] gitaly[1356]: time="2026-07-25T09:41:13.633Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-25T09:41:23.142" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:13.633" grpc.time_ms=0.163 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1734gitlab # [ 180.785963] gitaly[1356]: time="2026-07-25T09:41:13.649Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-25T09:41:23.155" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-07-25T09:41:13.645" grpc.time_ms=3.546 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1735gitlab # [ 180.815882] gitaly[1356]: time="2026-07-25T09:41:13.679Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:23.183" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:13.673" grpc.time_ms=5.731 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1736gitlab # [ 180.829463] gitaly[1356]: time="2026-07-25T09:41:13.691Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:23.195" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:13.685" grpc.time_ms=5.097 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1737gitlab # [ 180.864875] gitaly[1356]: time="2026-07-25T09:41:13.728Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=968 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-25T09:41:43.219" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:13.719" grpc.time_ms=8.749 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1738gitlab: (finished: waiting for unit setup-gitlab.service, in 181.72 seconds)1739gitlab: waiting for unit nixbot.service1740gitlab # [ 181.400770] nixbot[2981]: {"ts": "2026-07-25T09:41:14.264Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1741gitlab # [ 181.421232] nixbot[2981]: {"ts": "2026-07-25T09:41:14.284Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1742gitlab # [ 181.434213] nixbot[2981]: {"ts": "2026-07-25T09:41:14.297Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1743gitlab # [ 181.440295] nixbot[2981]: {"ts": "2026-07-25T09:41:14.303Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1744gitlab # [ 181.444796] nixbot[2981]: {"ts": "2026-07-25T09:41:14.308Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1745gitlab # [ 181.450151] nixbot[2981]: {"ts": "2026-07-25T09:41:14.313Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1746gitlab # [ 181.454662] nixbot[2981]: {"ts": "2026-07-25T09:41:14.318Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1747gitlab # [ 181.458907] nixbot[2981]: {"ts": "2026-07-25T09:41:14.322Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1748gitlab # [ 181.465510] nixbot[2981]: {"ts": "2026-07-25T09:41:14.329Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1749gitlab # [ 181.467767] nixbot[2981]: {"ts": "2026-07-25T09:41:14.331Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1750gitlab # [ 181.472083] nixbot[2981]: {"ts": "2026-07-25T09:41:14.335Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1751gitlab # [ 181.478596] nixbot[2981]: {"ts": "2026-07-25T09:41:14.342Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1752gitlab # [ 181.481620] nixbot[2981]: {"ts": "2026-07-25T09:41:14.345Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1753gitlab # [ 181.485903] nixbot[2981]: {"ts": "2026-07-25T09:41:14.349Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1754gitlab # [ 181.490821] nixbot[2981]: {"ts": "2026-07-25T09:41:14.354Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1755gitlab # [ 181.492972] nixbot[2981]: {"ts": "2026-07-25T09:41:14.356Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1756gitlab # [ 181.495874] nixbot[2981]: {"ts": "2026-07-25T09:41:14.359Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1757gitlab # [ 181.498760] nixbot[2981]: {"ts": "2026-07-25T09:41:14.362Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1758gitlab # [ 181.503498] nixbot[2981]: {"ts": "2026-07-25T09:41:14.367Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1759gitlab # [ 181.505652] nixbot[2981]: {"ts": "2026-07-25T09:41:14.369Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1760gitlab # [ 181.507913] nixbot[2981]: {"ts": "2026-07-25T09:41:14.371Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1761gitlab # [ 181.513414] nixbot[2981]: {"ts": "2026-07-25T09:41:14.376Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1762gitlab # [ 181.517587] nixbot[2981]: {"ts": "2026-07-25T09:41:14.381Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1763gitlab # [ 181.520840] nixbot[2981]: {"ts": "2026-07-25T09:41:14.384Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1764gitlab # [ 181.581231] gitaly[1356]: time="2026-07-25T09:41:14.444Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-25T09:41:24.291" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:14.442" grpc.time_ms=2.233 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 181.599146] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:14.462Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 1cad3f8dcab61599d4be7caef6e24d4ed336656d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"bd99f59a04422cdf714c50e7","created_at":"2026-07-25T09:41:13.099Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-4bac22c9ee5845b2","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:13.116Z","job_size_bytes":185,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-bd99f59a04422cdf714c50e7: done: 1.34333 sec","job_status":"done","queue_duration_s":0.002584,"scheduling_latency_s":0.002613,"gitaly_calls":14,"gitaly_duration_s":0.25433,"redis_calls":201,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.152032,"redis_read_bytes":922,"redis_write_bytes":19883,"redis_cache_calls":14,"redis_cache_duration_s":0.007173,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":32,"redis_feature_flag_duration_s":0.018647,"redis_feature_flag_read_bytes":540,"redis_feature_flag_write_bytes":4279,"redis_queues_calls":8,"redis_queues_duration_s":0.001623,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4934,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.007378,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":92,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.100852,"redis_repository_cache_read_bytes":214,"redis_repository_cache_write_bytes":6392,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.016359,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":51,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":51,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.098,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":51,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.65,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.67,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.098,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.409065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000434413,"exclusive_lock_hold_duration_s":0.019470352,"duration_s":1.34333,"completed_at":"2026-07-25T09:41:14.462Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.163981,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1766gitlab # [ 181.638635] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:14.463Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"54439ecf23008a56d459705a","created_at":"2026-07-25T09:41:13.206Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-ea2773fb96ac4cd2","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:13.217Z","job_size_bytes":46,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-54439ecf23008a56d459705a: start","job_status":"start","queue_duration_s":1.246568,"scheduling_latency_s":1.246583}1767gitlab # [ 181.664291] gitaly[1356]: time="2026-07-25T09:41:14.527Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-07-25T15:41:14.525" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:14.525" grpc.time_ms=2.115 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 181.676885] gitaly[1356]: time="2026-07-25T09:41:14.540Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-25T09:41:44.033" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:14.534" grpc.time_ms=5.986 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 181.708825] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:14.571Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"54439ecf23008a56d459705a","created_at":"2026-07-25T09:41:13.206Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-ea2773fb96ac4cd2","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:13.217Z","job_size_bytes":46,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-54439ecf23008a56d459705a: done: 0.108001 sec","job_status":"done","queue_duration_s":1.246568,"scheduling_latency_s":1.246583,"gitaly_calls":2,"gitaly_duration_s":0.045978,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.005524,"redis_read_bytes":68,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001112,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000543,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001404,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.001954,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":752,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000511,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000352,"duration_s":0.108001,"completed_at":"2026-07-25T09:41:14.571Z","load_balancing_strategy":"primary","db_duration_s":0.010458,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1770gitlab # [ 181.754123] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:14.617Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c595de05a80e7f2ff1ecb89c","created_at":"2026-07-25T09:41:13.288Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-ea2773fb96ac4cd2","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:13.308Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c595de05a80e7f2ff1ecb89c: start","job_status":"start","queue_duration_s":1.309014,"scheduling_latency_s":1.309056}1771gitlab # [ 181.830196] gitaly[1356]: time="2026-07-25T09:41:14.693Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 diskcache=734bfbb7-60f6-482a-8d63-001dc9f4af09 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-25T15:41:14.662" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:14.663" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 181.830688] gitaly[1356]: time="2026-07-25T09:41:14.694Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1286 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-25T15:41:14.662" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:14.663" grpc.time_ms=30.487 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 181.869307] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:14.732Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c595de05a80e7f2ff1ecb89c","created_at":"2026-07-25T09:41:13.288Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-ea2773fb96ac4cd2","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:13.308Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c595de05a80e7f2ff1ecb89c: done: 0.115218 sec","job_status":"done","queue_duration_s":1.309014,"scheduling_latency_s":1.309056,"gitaly_calls":1,"gitaly_duration_s":0.033466,"redis_calls":15,"redis_duration_s":0.003361,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000503,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001189,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000663,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.02,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.070830789,"duration_s":0.115218,"completed_at":"2026-07-25T09:41:14.732Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1774gitlab # [ 181.890549] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:14.734Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"abb96ed32641eca1481d1495","created_at":"2026-07-25T09:41:13.495Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-ea2773fb96ac4cd2","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:13.498Z","job_size_bytes":23,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-abb96ed32641eca1481d1495: start","job_status":"start","queue_duration_s":1.236026,"scheduling_latency_s":1.236053}1775gitlab # [ 181.903107] nixbot[2981]: INFO: Started server process [2981]1776gitlab # [ 181.904131] nixbot[2981]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1777gitlab # [ 181.907276] nixbot[2981]: INFO: ::ffff:127.0.0.1:40124 - "GET /health HTTP/1.1" 200 OK1778gitlab # [ 181.931327] systemd[1]: Started nixbot CI service.1779gitlab # [ 181.931672] systemd[1]: Reached target Multi-User System.1780gitlab # [ 181.932257] systemd[1]: Startup finished in 1.174s (kernel) + 4.073s (initrd) + 2min 56.684s (userspace) = 3min 1.932s.1781gitlab # [ 181.937294] gitaly[1356]: time="2026-07-25T09:41:14.800Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-25T09:41:44.292" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:14.792" grpc.time_ms=8.16 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1782gitlab # [ 181.957348] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:14.820Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"abb96ed32641eca1481d1495","created_at":"2026-07-25T09:41:13.495Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-ea2773fb96ac4cd2","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:13.498Z","job_size_bytes":23,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-abb96ed32641eca1481d1495: done: 0.086477 sec","job_status":"done","queue_duration_s":1.236026,"scheduling_latency_s":1.236053,"gitaly_calls":1,"gitaly_duration_s":0.059639,"redis_calls":16,"redis_duration_s":0.002741,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000252,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001112,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000581,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.086477,"completed_at":"2026-07-25T09:41:14.820Z","load_balancing_strategy":"primary","db_duration_s":0.003174,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1783gitlab # [ 181.999080] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:14.862Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"bb8864c5664b07513696ea56","created_at":"2026-07-25T09:41:14.420Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-ea2773fb96ac4cd2","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:754f934babb6ee1c6e01016563c926e0789a81579d2263be9d2f766ddc005770","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:14.423Z","job_size_bytes":467,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-bb8864c5664b07513696ea56: start","job_status":"start","queue_duration_s":0.438717,"scheduling_latency_s":0.438763}1784gitlab # [ 182.044632] gitaly[1356]: time="2026-07-25T09:41:14.908Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:44.406" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:14.907" grpc.time_ms=0.585 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785gitlab # [ 182.054772] gitaly[1356]: time="2026-07-25T09:41:14.918Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-25T09:41:24.009" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:14.909" grpc.time_ms=8.329 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786gitlab: (finished: waiting for unit nixbot.service, in 1.04 seconds)1787gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1788gitlab # [ 182.185298] nixbot[2981]: INFO: ::ffff:127.0.0.1:40138 - "GET /health HTTP/1.1" 200 OK1789gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1790subtest: project discovered and webhook registered1791gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1792gitlab # [ 182.241915] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.20.0" 391793gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.06 seconds)1794gitlab # [ 182.261363] gitaly[1356]: time="2026-07-25T09:41:15.125Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYCACYCJ8AXC2CTV7V4XVCY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-25T09:41:45.015" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:15.115" grpc.time_ms=9.314 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1795gitlab # [ 182.309995] gitaly[1356]: time="2026-07-25T09:41:15.173Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:41:45.072" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:15.172" grpc.time_ms=0.646 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1796gitlab # [ 182.316673] gitaly[1356]: time="2026-07-25T09:41:15.180Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=201 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-25T09:41:45.075" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:15.176" grpc.time_ms=4.014 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1797gitlab # [ 182.412617] gitaly[1356]: time="2026-07-25T09:41:15.276Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:25.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:15.265" grpc.time_ms=10.798 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 182.591587] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:15 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 6841799gitlab # [ 182.598922] nixbot[2981]: {"ts": "2026-07-25T09:41:15.462Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1800gitlab # [ 182.629870] nixbot[2981]: {"ts": "2026-07-25T09:41:15.493Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1801gitlab # [ 182.689486] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 441802gitlab # [ 182.690861] nixbot[2981]: {"ts": "2026-07-25T09:41:15.554Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1803gitlab # [ 182.692830] nixbot[2981]: {"ts": "2026-07-25T09:41:15.556Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1804gitlab # [ 182.774892] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 701805gitlab # [ 182.779931] nixbot[2981]: {"ts": "2026-07-25T09:41:15.640Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1806gitlab # [ 182.847607] gitaly[1356]: time="2026-07-25T09:41:15.710Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-25T09:41:45.600" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:15.701" grpc.time_ms=9.178 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 182.880833] gitaly[1356]: time="2026-07-25T09:41:15.724Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACTEHV1ZXGR2QWSM76TS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-25T09:41:45.612" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:15.713" grpc.time_ms=11.044 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 182.902125] sidekiq-cluster[2048]: {"severity":"WARN","time":"2026-07-25T09:41:15.746Z","class":"CreatePipelineWorker","correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"1cad3f8dcab61599d4be7caef6e24d4ed336656d","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"1cad3f8dcab61599d4be7caef6e24d4ed336656d","ref":"refs/heads/master"},"retry":0}1809gitlab # [ 182.908939] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:15.750Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"bb8864c5664b07513696ea56","created_at":"2026-07-25T09:41:14.420Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-ea2773fb96ac4cd2","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:754f934babb6ee1c6e01016563c926e0789a81579d2263be9d2f766ddc005770","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:14.423Z","job_size_bytes":467,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-bb8864c5664b07513696ea56: done: 0.888503 sec","job_status":"done","queue_duration_s":0.438717,"scheduling_latency_s":0.438763,"gitaly_calls":7,"gitaly_duration_s":0.111928,"redis_calls":53,"redis_duration_s":0.009172,"redis_read_bytes":171,"redis_write_bytes":4427,"redis_cache_calls":4,"redis_cache_duration_s":0.000748,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.004273,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001345,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00195,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000856,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":40,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":40,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.552093,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000223213,"duration_s":0.888503,"completed_at":"2026-07-25T09:41:15.750Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.191429,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1810gitlab # [ 182.953082] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:15.751Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"b185fa91547967eabbe90b6c","created_at":"2026-07-25T09:41:14.552Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-22103d8642e54704","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:14.558Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-b185fa91547967eabbe90b6c: start","job_status":"start","queue_duration_s":1.193499,"scheduling_latency_s":1.193513}1811gitlab # [ 182.967392] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:15.780Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"b185fa91547967eabbe90b6c","created_at":"2026-07-25T09:41:14.552Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-22103d8642e54704","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:14.558Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-b185fa91547967eabbe90b6c: done: 0.029157 sec","job_status":"done","queue_duration_s":1.193499,"scheduling_latency_s":1.193513,"redis_calls":19,"redis_duration_s":0.002885,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000539,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001361,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0048386029999999995,"duration_s":0.029157,"completed_at":"2026-07-25T09:41:15.780Z","load_balancing_strategy":"primary","db_duration_s":0.004697,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1812gitlab # [ 183.008574] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:15.781Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"b460f2357504d9b082f536f7","created_at":"2026-07-25T09:41:15.770Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-51ef84dbdc654864","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:15.773Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-b460f2357504d9b082f536f7: start","job_status":"start","queue_duration_s":0.008007,"scheduling_latency_s":0.008021}1813gitlab # [ 183.008889] nixbot[2981]: {"ts": "2026-07-25T09:41:15.830Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1814gitlab # [ 183.009536] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:15 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 1801815gitlab # [ 183.010061] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:15.843Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"b460f2357504d9b082f536f7","created_at":"2026-07-25T09:41:15.770Z","trace_propagation_headers":{"sentry-trace":"2018f5de45b74129903457addb01e0a7-51ef84dbdc654864","baggage":"sentry-trace_id=2018f5de45b74129903457addb01e0a7,sentry-release=Unknown"},"correlation_id":"01KYCACTEHV1ZXGR2QWSM76TS6","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:15.773Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-b460f2357504d9b082f536f7: done: 0.061234 sec","job_status":"done","queue_duration_s":0.008007,"scheduling_latency_s":0.008021,"redis_calls":11,"redis_duration_s":0.001738,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000329,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000432736,"duration_s":0.061234,"completed_at":"2026-07-25T09:41:15.843Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015741,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1816gitlab # [ 183.053708] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 541817gitlab # [ 183.054557] nixbot[2981]: {"ts": "2026-07-25T09:41:15.907Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1818gitlab # [ 183.084726] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:15 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 381819gitlab # [ 183.085874] nixbot[2981]: {"ts": "2026-07-25T09:41:15.949Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1820gitlab # [ 183.133438] gitaly[1356]: time="2026-07-25T09:41:15.996Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACZHJCTT32SYFZ5R8AS64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-07-25T09:41:45.184" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:15.985" grpc.time_ms=11.077 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab # [ 183.148881] gitaly[1356]: time="2026-07-25T09:41:16.006Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACZHJCTT32SYFZ5R8AS64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:46.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:16.005" grpc.time_ms=0.765 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1822gitlab # [ 183.155279] gitaly[1356]: time="2026-07-25T09:41:16.018Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACZHJCTT32SYFZ5R8AS64 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-25T09:41:26.008" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:16.008" grpc.time_ms=10.225 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab # [ 183.191615] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 731 "" "python-httpx/0.28.1" 1001824gitlab # [ 183.193847] nixbot[2981]: {"ts": "2026-07-25T09:41:16.056Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1825gitlab # [ 183.241237] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 431826gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1827gitlab # [ 183.247271] nixbot[2981]: {"ts": "2026-07-25T09:41:16.105Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1828gitlab # [ 183.247880] nixbot[2981]: {"ts": "2026-07-25T09:41:16.108Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1829gitlab # [ 183.328574] gitaly[1356]: time="2026-07-25T09:41:16.192Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACZQKTFRG9TB1CB8V1D2Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.181" grpc.time_ms=10.184 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1830gitlab # [ 183.356118] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 671831gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.11 seconds)1832(finished: subtest: project discovered and webhook registered, in 1.17 seconds)1833subtest: push delivers the webhook1834gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1835gitlab # [ 183.360604] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 761836gitlab # [ 183.418282] gitaly[1356]: time="2026-07-25T09:41:16.281Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACZT1241ZDQHG1F4WGGGP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.274" pid=1356 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1837gitlab # [ 183.418694] gitaly[1356]: time="2026-07-25T09:41:16.281Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACZT1241ZDQHG1F4WGGGP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.274" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1838gitlab # [ 183.419516] gitaly[1356]: time="2026-07-25T09:41:16.281Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACZT1241ZDQHG1F4WGGGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.274" grpc.time_ms=7.205 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1839gitlab # [ 183.420364] gitlab-workhorse[1288]: time="2026-07-25T09:41:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491840gitlab # [ 183.421662] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 581841gitlab # [ 183.422508] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:16 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 341842gitlab # [ 183.501468] gitaly[1356]: time="2026-07-25T09:41:16.365Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYCACZVYXKMB56JVPX5CT13T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.352" pid=1356 remote_ip="2001:db8:1::1" request_sha=44d206247de791b9d959917fb0a8b01f07da388b response_bytes=223 span.kind=server system=grpc1843gitlab # [ 183.501719] gitaly[1356]: time="2026-07-25T09:41:16.365Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1203 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACZVYXKMB56JVPX5CT13T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.352" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1844gitlab # [ 183.502171] gitaly[1356]: time="2026-07-25T09:41:16.365Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1203 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYCACZVYXKMB56JVPX5CT13T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.352" grpc.time_ms=12.732 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1845gitlab # [ 183.502867] gitlab-workhorse[1288]: time="2026-07-25T09:41:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231846gitlab # [ 183.503547] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.54.0" 791847gitlab # [ 183.567100] gitaly[1356]: time="2026-07-25T09:41:16.430Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCACZX7MKD1JQJHP6HER5SV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.423" grpc.time_ms=7.326 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1848gitlab # [ 183.568183] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:16 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.54.0" 1041849gitlab # Enumerating objects: 5, done.1850gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1851gitlab # Delta compression using up to 4 threads1852gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1853gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1854gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1855gitlab # [ 183.609431] gitaly[1356]: time="2026-07-25T09:41:16.472Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD008K6P84MFGEGC3C9EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=196 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.465" grpc.time_ms=7.496 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1856gitlab # [ 183.610171] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 491857gitlab # [ 183.661483] gitaly[1356]: time="2026-07-25T09:41:16.524Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD01V96QHEB8351T74VFH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.516" pid=1356 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1858gitlab # [ 183.661896] gitlab-workhorse[1288]: time="2026-07-25T09:41:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671859gitlab # [ 183.662511] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 491860gitlab # [ 183.663151] gitaly[1356]: time="2026-07-25T09:41:16.524Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD01V96QHEB8351T74VFH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.516" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1861gitlab # [ 183.663813] gitaly[1356]: time="2026-07-25T09:41:16.524Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD01V96QHEB8351T74VFH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.516" grpc.time_ms=8.016 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1862gitlab # [ 183.765442] gitaly[1356]: time="2026-07-25T09:41:16.629Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD05DBQ66K12F11CDTN3P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.620" grpc.time_ms=8.485 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1863gitlab # [ 183.766884] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 401864gitlab # [ 183.836216] gitaly[1356]: time="2026-07-25T09:41:16.699Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD076CKZP2J8KGJY4DT9R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.684" pid=1356 remote_ip="2001:db8:1::1" request_sha=69dcef142412daaffeeda28f6446e517599d516e response_bytes=209 span.kind=server system=grpc1865gitlab # [ 183.836493] gitaly[1356]: time="2026-07-25T09:41:16.699Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD076CKZP2J8KGJY4DT9R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.684" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1866gitlab # [ 183.847768] gitaly[1356]: time="2026-07-25T09:41:16.711Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD076CKZP2J8KGJY4DT9R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.684" grpc.time_ms=26.058 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1867gitlab # [ 183.875652] gitlab-workhorse[1288]: time="2026-07-25T09:41:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091868gitlab # [ 183.876152] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.54.0" 921869gitlab # [ 183.908131] gitaly[1356]: time="2026-07-25T09:41:16.771Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-25T09:41:26.005" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:16.766" grpc.time_ms=5.571 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1870gitlab # [ 183.939238] gitaly[1356]: time="2026-07-25T09:41:16.802Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-25T09:41:46.796" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-25T09:41:16.796" grpc.time_ms=5.599 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1871gitlab # [ 183.955349] gitaly[1356]: time="2026-07-25T09:41:16.818Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD0BA4PTS3WGR7S0XC0R8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:46.717" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:16.817" grpc.time_ms=1.332 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1872gitlab # [ 183.965606] gitaly[1356]: time="2026-07-25T09:41:16.829Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KYCAD01A65T453F6XNF85BX4 duration_ms=193ns method=POST pid=1356 status=200 url="http://unix/api/v4/internal/allowed"1873gitlab # [ 183.986491] gitaly[1356]: time="2026-07-25T09:41:16.850Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KYCAD01A65T453F6XNF85BX4 duration_ms=19ns method=POST pid=1356 status=200 url="http://unix/api/v4/internal/pre_receive"1874gitlab # [ 183.989731] gitaly[1356]: time="2026-07-25T09:41:16.853Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5321 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:16.635" grpc.time_ms=218.264 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1875gitlab # [ 184.001377] gitaly[1356]: time="2026-07-25T09:41:16.864Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD0BA4PTS3WGR7S0XC0R8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-25T09:41:46.758" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:16.858" grpc.time_ms=5.999 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876gitlab # [ 184.012106] gitaly[1356]: time="2026-07-25T09:41:16.875Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD0BA4PTS3WGR7S0XC0R8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:26.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:16.870" grpc.time_ms=5.391 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab # [ 184.050508] gitaly[1356]: time="2026-07-25T09:41:16.914Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:16.913" grpc.time_ms=0.378 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1878gitlab # [ 184.064438] gitaly[1356]: time="2026-07-25T09:41:16.928Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD0BA4PTS3WGR7S0XC0R8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-25T09:41:26.067" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:16.927" grpc.time_ms=0.312 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1879gitlab # [ 184.076279] gitaly[1356]: time="2026-07-25T09:41:16.939Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD0BA4PTS3WGR7S0XC0R8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-25T09:41:26.074" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:16.934" grpc.time_ms=5.501 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1880gitlab # [ 184.091494] gitaly[1356]: time="2026-07-25T09:41:16.955Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4790 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:16.954" grpc.time_ms=0.238 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1881gitlab # [ 184.111932] gitaly[1356]: time="2026-07-25T09:41:16.975Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:16.974" grpc.time_ms=0.387 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1882gitlab # [ 184.127628] gitaly[1356]: time="2026-07-25T09:41:16.991Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD0BA4PTS3WGR7S0XC0R8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4158 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:16.990" grpc.time_ms=0.312 pid=1356 span.kind=server system=grpc1883gitlab # [ 184.159947] gitaly[1356]: time="2026-07-25T09:41:17.023Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD0BA4PTS3WGR7S0XC0R8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4160 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:17.023" grpc.time_ms=0.482 pid=1356 span.kind=server system=grpc1884gitlab # [ 184.180614] gitaly[1356]: time="2026-07-25T09:41:17.044Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD0BA4PTS3WGR7S0XC0R8 diskcache=24fc1c98-51cb-4068-b014-80c8947bde4e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T09:41:26.095" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:16.955" pid=1356 ref=refs/keep-around/1cad3f8dcab61599d4be7caef6e24d4ed336656d remote_ip="2001:db8:1::1" revision=1cad3f8dcab61599d4be7caef6e24d4ed336656d span.kind=server system=grpc username=root1885gitlab # [ 184.186346] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:17.047Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","1cad3f8dcab61599d4be7caef6e24d4ed336656d ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"53a1f591cef79bdae46a30c7","created_at":"2026-07-25T09:41:17.043Z","trace_propagation_headers":{"sentry-trace":"cbd8c4e692834731a2e56c8d4fc06b03-b8f49ee4cc434258","baggage":"sentry-trace_id=cbd8c4e692834731a2e56c8d4fc06b03,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD01A65T453F6XNF85BX4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.046Z","job_size_bytes":185,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-53a1f591cef79bdae46a30c7: start","job_status":"start","queue_duration_s":0.001359,"scheduling_latency_s":0.001394}1886gitlab # [ 184.195170] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:17.058Z","message":"changes: \"1cad3f8dcab61599d4be7caef6e24d4ed336656d ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 refs/heads/master\\n\""}1887gitlab # [ 184.195882] gitaly[1356]: time="2026-07-25T09:41:17.059Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KYCAD01A65T453F6XNF85BX4 duration_ms=44ns method=POST pid=1356 status=200 url="http://unix/api/v4/internal/post_receive"1888gitlab # [ 184.196602] gitaly[1356]: time="2026-07-25T09:41:17.059Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4815 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:17.014" grpc.time_ms=45.075 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1889gitlab # [ 184.224290] gitaly[1356]: time="2026-07-25T09:41:17.087Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:27.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:17.081" grpc.time_ms=6.389 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1890gitlab # [ 184.236903] gitaly[1356]: time="2026-07-25T09:41:17.097Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T09:41:27.012" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:17.092" grpc.time_ms=5.176 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1891gitlab # [ 184.250731] gitaly[1356]: time="2026-07-25T09:41:17.113Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-25T09:41:27.027" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:17.107" grpc.time_ms=5.992 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1892gitlab # [ 184.266252] gitaly[1356]: time="2026-07-25T09:41:17.129Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=48 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5323 command.oublock=8 command.real_time_ms=79 command.spawn_token_fork_ms=4 command.system_time_ms=31 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD0BA4PTS3WGR7S0XC0R8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T09:41:26.095" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:16.955" grpc.time_ms=88.914 pid=1356 ref=refs/keep-around/1cad3f8dcab61599d4be7caef6e24d4ed336656d remote_ip="2001:db8:1::1" revision=1cad3f8dcab61599d4be7caef6e24d4ed336656d span.kind=server system=grpc username=root1893gitlab # [ 184.282786] gitaly[1356]: time="2026-07-25T09:41:17.146Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=7 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-07-25T09:41:47.016" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:17.117" grpc.time_ms=29.371 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1894gitlab # [ 184.284681] gitaly[1356]: time="2026-07-25T09:41:17.148Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD0BA4PTS3WGR7S0XC0R8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:47.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:17.144" grpc.time_ms=3.335 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1895gitlab # [ 184.292645] gitaly[1356]: time="2026-07-25T09:41:17.156Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 diskcache=535566e4-784e-48ab-a24d-2f0ab9a1affc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.580" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1896gitlab # To http://gitlab/root/test-flake.git1897gitlab # [ 184.293686] gitaly[1356]: time="2026-07-25T09:41:17.156Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=219 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13312 command.oublock=32 command.real_time_ms=564 command.spawn_token_fork_ms=0 command.system_time_ms=171 command.user_time_ms=48 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:16.580" grpc.time_ms=575.823 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1898gitlab # 1cad3f8..ef26aec [ 184.294705] gitlab-workhorse[1288]: time="2026-07-25T09:41:17Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521899gitlab # master -> master[ 184.295655] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:17 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 6981900gitlab # 1901gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.99 seconds)1902gitlab: must succeed: git -C /tmp/test-flake rev-parse master1903gitlab # [ 184.348705] gitaly[1356]: time="2026-07-25T09:41:17.212Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=348 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-25T09:41:27.128" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-07-25T09:41:17.208" grpc.time_ms=3.404 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1904gitlab # [ 184.360963] gitaly[1356]: time="2026-07-25T09:41:17.223Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:27.138" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:17.219" grpc.time_ms=4.717 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1905gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.03 seconds)1906gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ef26aec7a6eb23a0fd26815f9e1b8cba9e401291'1907gitlab # [ 184.392149] nixbot[2981]: INFO: ::ffff:127.0.0.1:39038 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 HTTP/1.1" 200 OK1908gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', in 0.02 seconds)1909gitlab # [ 184.445286] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1cad3f8dcab61599d4be7caef6e24d4ed336656d HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5291910gitlab # [ 184.445807] nixbot[2981]: {"ts": "2026-07-25T09:41:17.309Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1cad3f8dcab61599d4be7caef6e24d4ed336656d \"HTTP/1.1 201 Created\""}1911gitlab # [ 184.451507] nixbot[2981]: {"ts": "2026-07-25T09:41:17.315Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-1cad3f8dcab6-bb10daa5", "argv0": "bwrap"}1912gitlab # [ 184.521529] systemd[1]: Started Nix Daemon.1913gitlab # [ 184.544942] gitaly[1356]: time="2026-07-25T09:41:17.408Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-25T09:41:27.147" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:17.407" grpc.time_ms=0.933 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1914gitlab # [ 184.559587] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:17.422Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","1cad3f8dcab61599d4be7caef6e24d4ed336656d ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"53a1f591cef79bdae46a30c7","created_at":"2026-07-25T09:41:17.043Z","trace_propagation_headers":{"sentry-trace":"cbd8c4e692834731a2e56c8d4fc06b03-b8f49ee4cc434258","baggage":"sentry-trace_id=cbd8c4e692834731a2e56c8d4fc06b03,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD01A65T453F6XNF85BX4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.046Z","job_size_bytes":185,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-53a1f591cef79bdae46a30c7: done: 0.375108 sec","job_status":"done","queue_duration_s":0.001359,"scheduling_latency_s":0.001394,"gitaly_calls":7,"gitaly_duration_s":0.122901,"redis_calls":111,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.015435,"redis_read_bytes":479,"redis_write_bytes":13164,"redis_cache_calls":5,"redis_cache_duration_s":0.001168,"redis_cache_read_bytes":13,"redis_cache_write_bytes":347,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.001931,"redis_feature_flag_read_bytes":132,"redis_feature_flag_write_bytes":665,"redis_queues_calls":8,"redis_queues_duration_s":0.00167,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6768,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001523,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.005074,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.004069,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":29,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":29,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.205113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00041821,"exclusive_lock_hold_duration_s":0.014180294,"duration_s":0.375108,"completed_at":"2026-07-25T09:41:17.422Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032291,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1915gitlab # [ 184.568592] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:17.424Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d13d9cce900ebeb11697b25b","created_at":"2026-07-25T09:41:17.099Z","trace_propagation_headers":{"sentry-trace":"cbd8c4e692834731a2e56c8d4fc06b03-f15e227a02f44dfd","baggage":"sentry-trace_id=cbd8c4e692834731a2e56c8d4fc06b03,sentry-release=Unknown"},"correlation_id":"01KYCAD01A65T453F6XNF85BX4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.100Z","job_size_bytes":46,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d13d9cce900ebeb11697b25b: start","job_status":"start","queue_duration_s":0.323639,"scheduling_latency_s":0.323656}1916gitlab # [ 184.609696] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:17.440Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d13d9cce900ebeb11697b25b","created_at":"2026-07-25T09:41:17.099Z","trace_propagation_headers":{"sentry-trace":"cbd8c4e692834731a2e56c8d4fc06b03-f15e227a02f44dfd","baggage":"sentry-trace_id=cbd8c4e692834731a2e56c8d4fc06b03,sentry-release=Unknown"},"correlation_id":"01KYCAD01A65T453F6XNF85BX4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.100Z","job_size_bytes":46,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d13d9cce900ebeb11697b25b: done: 0.016334 sec","job_status":"done","queue_duration_s":0.323639,"scheduling_latency_s":0.323656,"redis_calls":18,"redis_duration_s":0.00243,"redis_read_bytes":667,"redis_write_bytes":1652,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001108,"redis_feature_flag_read_bytes":644,"redis_feature_flag_write_bytes":870,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000154,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000454,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016334,"completed_at":"2026-07-25T09:41:17.440Z","load_balancing_strategy":"primary","db_duration_s":0.001485,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1917gitlab # [ 184.655973] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:17.441Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a571e486d6cec7a1e82e5451","created_at":"2026-07-25T09:41:17.104Z","trace_propagation_headers":{"sentry-trace":"cbd8c4e692834731a2e56c8d4fc06b03-f15e227a02f44dfd","baggage":"sentry-trace_id=cbd8c4e692834731a2e56c8d4fc06b03,sentry-release=Unknown"},"correlation_id":"01KYCAD01A65T453F6XNF85BX4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.105Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a571e486d6cec7a1e82e5451: start","job_status":"start","queue_duration_s":0.335617,"scheduling_latency_s":0.33563}1918gitlab # [ 184.656879] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:17.491Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a571e486d6cec7a1e82e5451","created_at":"2026-07-25T09:41:17.104Z","trace_propagation_headers":{"sentry-trace":"cbd8c4e692834731a2e56c8d4fc06b03-f15e227a02f44dfd","baggage":"sentry-trace_id=cbd8c4e692834731a2e56c8d4fc06b03,sentry-release=Unknown"},"correlation_id":"01KYCAD01A65T453F6XNF85BX4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.105Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a571e486d6cec7a1e82e5451: done: 0.049816 sec","job_status":"done","queue_duration_s":0.335617,"scheduling_latency_s":0.33563,"gitaly_calls":1,"gitaly_duration_s":0.030111,"redis_calls":12,"redis_duration_s":0.0021319999999999998,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000516,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.038855497,"duration_s":0.049816,"completed_at":"2026-07-25T09:41:17.491Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003572,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1919gitlab # [ 184.713764] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:17.493Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"a3ff5cf9f1e39edc103673f3","created_at":"2026-07-25T09:41:17.183Z","trace_propagation_headers":{"sentry-trace":"ed408bd59e594bb3a1a77ca0815acfee-27fdd2278e3f439b","baggage":"sentry-trace_id=ed408bd59e594bb3a1a77ca0815acfee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD0BA4PTS3WGR7S0XC0R8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.188Z","job_size_bytes":65,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-a3ff5cf9f1e39edc103673f3: start","job_status":"start","queue_duration_s":0.304671,"scheduling_latency_s":0.304716}1920gitlab # [ 184.714695] gitaly[1356]: time="2026-07-25T09:41:17.480Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 diskcache=f0151980-8d03-47f5-8e14-6402117545a0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-25T15:41:17.451" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:17.452" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1921gitlab # [ 184.715222] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:17.534Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"a3ff5cf9f1e39edc103673f3","created_at":"2026-07-25T09:41:17.183Z","trace_propagation_headers":{"sentry-trace":"ed408bd59e594bb3a1a77ca0815acfee-27fdd2278e3f439b","baggage":"sentry-trace_id=ed408bd59e594bb3a1a77ca0815acfee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD0BA4PTS3WGR7S0XC0R8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.188Z","job_size_bytes":65,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-a3ff5cf9f1e39edc103673f3: done: 0.04115 sec","job_status":"done","queue_duration_s":0.304671,"scheduling_latency_s":0.304716,"redis_calls":18,"redis_duration_s":0.002637,"redis_read_bytes":271,"redis_write_bytes":2103,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001391,"redis_feature_flag_read_bytes":264,"redis_feature_flag_write_bytes":1285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000199746,"duration_s":0.04115,"completed_at":"2026-07-25T09:41:17.534Z","load_balancing_strategy":"primary","db_duration_s":0.007552,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1922gitlab # [ 184.765179] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:17.535Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b81af6abd12fdea30d05195f","created_at":"2026-07-25T09:41:17.188Z","trace_propagation_headers":{"sentry-trace":"ed408bd59e594bb3a1a77ca0815acfee-27fdd2278e3f439b","baggage":"sentry-trace_id=ed408bd59e594bb3a1a77ca0815acfee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD0BA4PTS3WGR7S0XC0R8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.191Z","job_size_bytes":65,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b81af6abd12fdea30d05195f: start","job_status":"start","queue_duration_s":0.343667,"scheduling_latency_s":0.34368}1923gitlab # [ 184.765832] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:17.572Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b81af6abd12fdea30d05195f","created_at":"2026-07-25T09:41:17.188Z","trace_propagation_headers":{"sentry-trace":"ed408bd59e594bb3a1a77ca0815acfee-27fdd2278e3f439b","baggage":"sentry-trace_id=ed408bd59e594bb3a1a77ca0815acfee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD0BA4PTS3WGR7S0XC0R8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.191Z","job_size_bytes":65,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b81af6abd12fdea30d05195f: done: 0.037548 sec","job_status":"done","queue_duration_s":0.343667,"scheduling_latency_s":0.34368,"redis_calls":15,"redis_duration_s":0.001843,"redis_read_bytes":142,"redis_write_bytes":1431,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000369,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":431,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00077,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000704,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000186336,"duration_s":0.037548,"completed_at":"2026-07-25T09:41:17.572Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00703,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1924gitlab # [ 184.807790] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:17.573Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"875204bdb4957109337a0ad1","created_at":"2026-07-25T09:41:17.255Z","trace_propagation_headers":{"sentry-trace":"cbd8c4e692834731a2e56c8d4fc06b03-f15e227a02f44dfd","baggage":"sentry-trace_id=cbd8c4e692834731a2e56c8d4fc06b03,sentry-release=Unknown"},"correlation_id":"01KYCAD01A65T453F6XNF85BX4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dc83a28ab4dcc7415848429b3359e8c9f23656ced62708c707c4781feea3fdba","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.256Z","job_size_bytes":467,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-875204bdb4957109337a0ad1: start","job_status":"start","queue_duration_s":0.316869,"scheduling_latency_s":0.316882}1925gitlab # [ 184.850954] gitaly[1356]: time="2026-07-25T09:41:17.480Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1648 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-25T15:41:17.451" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:17.452" grpc.time_ms=28.132 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1926gitlab # [ 184.851716] gitaly[1356]: time="2026-07-25T09:41:17.587Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:47.486" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:17.586" grpc.time_ms=0.436 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1927gitlab # [ 184.852487] gitaly[1356]: time="2026-07-25T09:41:17.593Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-25T09:41:27.008" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:17.588" grpc.time_ms=5.031 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1928gitlab # [ 184.853122] gitaly[1356]: time="2026-07-25T09:41:17.614Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:41:47.514" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:17.614" grpc.time_ms=0.489 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1929gitlab # [ 184.861057] gitaly[1356]: time="2026-07-25T09:41:17.618Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=35 command.oublock=0 command.real_time_ms=0 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-25T09:41:47.516" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:17.616" grpc.time_ms=1.277 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1930gitlab # [ 184.875985] gitaly[1356]: time="2026-07-25T09:41:17.649Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:27.064" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:17.644" grpc.time_ms=4.619 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931gitlab # [ 184.952546] nix-daemon[3270]: accepted connection from pid 3269, user nixbot1932gitlab # [ 184.953563] nix-daemon[3270]: accepted connection from pid 3268, user nixbot1933gitlab # [ 185.214655] gitaly[1356]: time="2026-07-25T09:41:18.078Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-25T09:41:48.060" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:18.061" grpc.time_ms=16.698 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1934gitlab # [ 185.232831] gitaly[1356]: time="2026-07-25T09:41:18.096Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD01A65T453F6XNF85BX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-25T09:41:48.081" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:18.081" grpc.time_ms=15.075 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1935gitlab # [ 185.249325] sidekiq-cluster[2048]: {"severity":"WARN","time":"2026-07-25T09:41:18.112Z","class":"CreatePipelineWorker","correlation_id":"01KYCAD01A65T453F6XNF85BX4","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"1cad3f8dcab61599d4be7caef6e24d4ed336656d","after":"ef26aec7a6eb23a0fd26815f9e1b8cba9e401291","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"ef26aec7a6eb23a0fd26815f9e1b8cba9e401291","ref":"refs/heads/master"},"retry":0}1936gitlab # [ 185.256220] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:18.119Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"875204bdb4957109337a0ad1","created_at":"2026-07-25T09:41:17.255Z","trace_propagation_headers":{"sentry-trace":"cbd8c4e692834731a2e56c8d4fc06b03-f15e227a02f44dfd","baggage":"sentry-trace_id=cbd8c4e692834731a2e56c8d4fc06b03,sentry-release=Unknown"},"correlation_id":"01KYCAD01A65T453F6XNF85BX4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dc83a28ab4dcc7415848429b3359e8c9f23656ced62708c707c4781feea3fdba","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.256Z","job_size_bytes":467,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-875204bdb4957109337a0ad1: done: 0.545532 sec","job_status":"done","queue_duration_s":0.316869,"scheduling_latency_s":0.316882,"gitaly_calls":7,"gitaly_duration_s":0.056602,"redis_calls":33,"redis_duration_s":0.003892,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000399,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001396,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001189,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.098,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.095,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.386807,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.545532,"completed_at":"2026-07-25T09:41:18.119Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.097213,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1937gitlab # [ 185.309113] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:18.121Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"343667519f4f30e1049f4c8c","created_at":"2026-07-25T09:41:17.291Z","trace_propagation_headers":{"sentry-trace":"ed408bd59e594bb3a1a77ca0815acfee-27fdd2278e3f439b","baggage":"sentry-trace_id=ed408bd59e594bb3a1a77ca0815acfee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD0BA4PTS3WGR7S0XC0R8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.296Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-343667519f4f30e1049f4c8c: start","job_status":"start","queue_duration_s":0.825043,"scheduling_latency_s":0.825078}1938gitlab # [ 185.336766] gitaly[1356]: time="2026-07-25T09:41:18.200Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD0BA4PTS3WGR7S0XC0R8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:41:48.099" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:18.199" grpc.time_ms=0.637 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 185.369437] gitaly[1356]: time="2026-07-25T09:41:18.233Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD0BA4PTS3WGR7S0XC0R8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:48.131" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:18.231" grpc.time_ms=0.738 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ef26aec7a6eb23a0fd26815f9e1b8cba9e401291'1941gitlab # [ 185.422721] nixbot[2981]: INFO: ::ffff:127.0.0.1:39054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 HTTP/1.1" 200 OK1942gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', in 0.03 seconds)1943gitlab # [ 185.460786] gitaly[1356]: time="2026-07-25T09:41:18.324Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD0BA4PTS3WGR7S0XC0R8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:48.222" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:18.323" grpc.time_ms=0.803 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1944gitlab # [ 185.493554] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:18.356Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"343667519f4f30e1049f4c8c","created_at":"2026-07-25T09:41:17.291Z","trace_propagation_headers":{"sentry-trace":"ed408bd59e594bb3a1a77ca0815acfee-27fdd2278e3f439b","baggage":"sentry-trace_id=ed408bd59e594bb3a1a77ca0815acfee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD0BA4PTS3WGR7S0XC0R8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.296Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-343667519f4f30e1049f4c8c: done: 0.235282 sec","job_status":"done","queue_duration_s":0.825043,"scheduling_latency_s":0.825078,"gitaly_calls":3,"gitaly_duration_s":0.0087,"redis_calls":48,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007005,"redis_read_bytes":208,"redis_write_bytes":6803,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.0007,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":16,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001295,"redis_cache_read_bytes":32,"redis_cache_write_bytes":1470,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.001035,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":2,"redis_queues_duration_s":0.000177,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001623,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000268,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000147,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.093,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.074,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.176455,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.18225612500000002,"duration_s":0.235282,"completed_at":"2026-07-25T09:41:18.356Z","load_balancing_strategy":"primary","db_duration_s":0.100751,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1945gitlab # [ 185.551688] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:18.358Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"a2c73ff8-56ed-4ade-8b75-cd0c7100a7fe\"}"],"class":"WebHookWorker","jid":"23d395ea76215bca6ad27618","created_at":"2026-07-25T09:41:17.394Z","trace_propagation_headers":{"sentry-trace":"cbd8c4e692834731a2e56c8d4fc06b03-f15e227a02f44dfd","baggage":"sentry-trace_id=cbd8c4e692834731a2e56c8d4fc06b03,sentry-release=Unknown"},"correlation_id":"01KYCAD01A65T453F6XNF85BX4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cca94608a6c1eeae4a0f1edb68917ccb8aa14664537a7e1b72f5585318f1e3ce","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.399Z","job_size_bytes":1749,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-23d395ea76215bca6ad27618: start","job_status":"start","queue_duration_s":0.958683,"scheduling_latency_s":0.958698}1946gitlab # [ 185.636083] nixbot[2981]: INFO: ::ffff:127.0.0.1:39060 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1947gitlab # [ 185.648992] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:18.512Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"a2c73ff8-56ed-4ade-8b75-cd0c7100a7fe\"}"],"class":"WebHookWorker","jid":"23d395ea76215bca6ad27618","created_at":"2026-07-25T09:41:17.394Z","trace_propagation_headers":{"sentry-trace":"cbd8c4e692834731a2e56c8d4fc06b03-f15e227a02f44dfd","baggage":"sentry-trace_id=cbd8c4e692834731a2e56c8d4fc06b03,sentry-release=Unknown"},"correlation_id":"01KYCAD01A65T453F6XNF85BX4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cca94608a6c1eeae4a0f1edb68917ccb8aa14664537a7e1b72f5585318f1e3ce","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:17.399Z","job_size_bytes":1749,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-23d395ea76215bca6ad27618: done: 0.153903 sec","job_status":"done","queue_duration_s":0.958683,"scheduling_latency_s":0.958698,"redis_calls":19,"redis_duration_s":0.003951,"redis_read_bytes":31,"redis_write_bytes":5282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000971,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000302,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3644,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001707,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.020116243999979133,"cpu_s":0.061582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000368483,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.153903,"completed_at":"2026-07-25T09:41:18.512Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002377,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1948gitlab # [ 185.717104] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:18.580Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"ba78c62918d80c1146bed35c","created_at":"2026-07-25T09:41:18.186Z","trace_propagation_headers":{"sentry-trace":"ed408bd59e594bb3a1a77ca0815acfee-26f561be791b48be","baggage":"sentry-trace_id=ed408bd59e594bb3a1a77ca0815acfee,sentry-release=Unknown"},"correlation_id":"01KYCAD0BA4PTS3WGR7S0XC0R8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:18.188Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ba78c62918d80c1146bed35c: start","job_status":"start","queue_duration_s":0.391449,"scheduling_latency_s":0.391478}1949gitlab # [ 185.755794] gitaly[1356]: time="2026-07-25T09:41:18.619Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD227JK3R6QT5EC0NH09T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:18.611" grpc.time_ms=7.78 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1950gitlab # [ 185.756569] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 831951gitlab # [ 185.783537] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:18.646Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"ba78c62918d80c1146bed35c","created_at":"2026-07-25T09:41:18.186Z","trace_propagation_headers":{"sentry-trace":"ed408bd59e594bb3a1a77ca0815acfee-26f561be791b48be","baggage":"sentry-trace_id=ed408bd59e594bb3a1a77ca0815acfee,sentry-release=Unknown"},"correlation_id":"01KYCAD0BA4PTS3WGR7S0XC0R8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:18.188Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ba78c62918d80c1146bed35c: done: 0.066571 sec","job_status":"done","queue_duration_s":0.391449,"scheduling_latency_s":0.391478,"redis_calls":10,"redis_duration_s":0.022378000000000002,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.019001,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003119,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002531048,"duration_s":0.066571,"completed_at":"2026-07-25T09:41:18.646Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002645,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1952gitlab # [ 185.794184] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:18.657Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","23d395ea76215bca6ad27618"],"class":"WebHooks::LogExecutionWorker","jid":"362a40d279e177e403138ce4","created_at":"2026-07-25T09:41:18.502Z","trace_propagation_headers":{"sentry-trace":"cbd8c4e692834731a2e56c8d4fc06b03-0fed04281be44f8e","baggage":"sentry-trace_id=cbd8c4e692834731a2e56c8d4fc06b03,sentry-release=Unknown"},"correlation_id":"01KYCAD01A65T453F6XNF85BX4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e1e602af3feeda2b3e035ef2a453fcac3b85609d30abdc07e6bfbb3dbb265342","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:18.506Z","job_size_bytes":2507,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-362a40d279e177e403138ce4: start","job_status":"start","queue_duration_s":0.150745,"scheduling_latency_s":0.150761}1953gitlab # [ 185.879920] gitaly[1356]: time="2026-07-25T09:41:18.742Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD24X5P9M62FPKTVMYW88 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:18.732" pid=1356 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1954gitlab # [ 185.880617] gitaly[1356]: time="2026-07-25T09:41:18.743Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD24X5P9M62FPKTVMYW88 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:18.732" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1955gitlab # [ 185.881648] gitlab-workhorse[1288]: time="2026-07-25T09:41:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671956gitlab # [ 185.882520] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 1221957gitlab # [ 185.883312] gitaly[1356]: time="2026-07-25T09:41:18.743Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD24X5P9M62FPKTVMYW88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:18.732" grpc.time_ms=10.946 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1958gitlab # [ 185.911336] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:18.774Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","23d395ea76215bca6ad27618"],"class":"WebHooks::LogExecutionWorker","jid":"362a40d279e177e403138ce4","created_at":"2026-07-25T09:41:18.502Z","trace_propagation_headers":{"sentry-trace":"cbd8c4e692834731a2e56c8d4fc06b03-0fed04281be44f8e","baggage":"sentry-trace_id=cbd8c4e692834731a2e56c8d4fc06b03,sentry-release=Unknown"},"correlation_id":"01KYCAD01A65T453F6XNF85BX4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e1e602af3feeda2b3e035ef2a453fcac3b85609d30abdc07e6bfbb3dbb265342","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:18.506Z","job_size_bytes":2507,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-362a40d279e177e403138ce4: done: 0.117042 sec","job_status":"done","queue_duration_s":0.150745,"scheduling_latency_s":0.150761,"redis_calls":10,"redis_duration_s":0.025566000000000002,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000279,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.024888,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000399,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.022,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.022,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032574,"duration_s":0.117042,"completed_at":"2026-07-25T09:41:18.774Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005516,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1959gitlab # [ 186.054628] gitaly[1356]: time="2026-07-25T09:41:18.917Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2BE4A2HQWFKVSVSNSKY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:18.895" pid=1356 remote_ip="2001:db8:1::1" request_sha=a1926698fdfa13a361c6fefa354bc92d8ddc45a8 response_bytes=337 span.kind=server system=grpc1960gitlab # [ 186.055456] gitaly[1356]: time="2026-07-25T09:41:18.917Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2BE4A2HQWFKVSVSNSKY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:18.895" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1961gitlab # [ 186.057601] gitaly[1356]: time="2026-07-25T09:41:18.921Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2BE4A2HQWFKVSVSNSKY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:18.895" grpc.time_ms=25.583 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1962gitlab # [ 186.102918] gitlab-workhorse[1288]: time="2026-07-25T09:41:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371963gitlab # [ 186.103859] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.54.0" 1361964gitlab # [ 186.227020] gitaly[1356]: time="2026-07-25T09:41:19.090Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD2HB2TN98VMPD57RT2PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:19.076" grpc.time_ms=14.007 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1965gitlab # [ 186.256603] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1001966gitlab # [ 186.317721] gitaly[1356]: time="2026-07-25T09:41:19.181Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2MN2P2D64GS4NYWR7TD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:19.161" pid=1356 remote_ip="2001:db8:1::1" request_sha=f1e6bb59289c4d43fc3699ed3fc4760ee01ef0e9 response_bytes=216 span.kind=server system=grpc1967gitlab # [ 186.317977] gitaly[1356]: time="2026-07-25T09:41:19.181Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2MN2P2D64GS4NYWR7TD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:19.161" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1968gitlab # [ 186.319471] gitaly[1356]: time="2026-07-25T09:41:19.181Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2MN2P2D64GS4NYWR7TD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:19.161" grpc.time_ms=20.614 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc1969gitlab # [ 186.320901] gitlab-workhorse[1288]: time="2026-07-25T09:41:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161970gitlab # [ 186.321749] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.54.0" 571971gitlab # [ 186.413775] nixbot[2981]: {"ts": "2026-07-25T09:41:19.277Z", "level": "info", "logger": "nixbot.canceller", "msg": "cancelling build", "build_id": 1, "reason": "superseded"}1972gitlab # [ 186.418324] nix-daemon[3287]: unexpected Nix daemon error: error: interrupted by the user1973gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ef26aec7a6eb23a0fd26815f9e1b8cba9e401291'1974gitlab # [ 186.451435] nixbot[2981]: INFO: ::ffff:127.0.0.1:39070 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 HTTP/1.1" 200 OK1975gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', in 0.03 seconds)1976(finished: subtest: push delivers the webhook, in 3.10 seconds)1977subtest: eval and build post commit statuses1978gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses1979gitlab # [ 186.480268] gitaly[1356]: time="2026-07-25T09:41:19.343Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=1 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SY5MC5XQYKYAD2GXH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:49.240" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:19.340" grpc.time_ms=2.598 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 186.494110] gitaly[1356]: time="2026-07-25T09:41:19.356Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SGQNS0NGK7XR1866FQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:49.355" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:19.355" grpc.time_ms=0.492 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1981gitlab # [ 186.512596] gitaly[1356]: time="2026-07-25T09:41:19.376Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD2SGQNS0NGK7XR1866FQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-25T09:41:49.370" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:19.370" grpc.time_ms=5.591 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982gitlab # [ 186.530673] gitaly[1356]: time="2026-07-25T09:41:19.394Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD2SGQNS0NGK7XR1866FQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:29.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:19.389" grpc.time_ms=4.921 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1983gitlab # [ 186.570463] gitaly[1356]: time="2026-07-25T09:41:19.434Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SGQNS0NGK7XR1866FQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-25T09:41:29.053" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:19.433" grpc.time_ms=0.35 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 186.581099] gitaly[1356]: time="2026-07-25T09:41:19.444Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SGQNS0NGK7XR1866FQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-25T09:41:29.056" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:19.437" grpc.time_ms=7.372 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1985gitlab # [ 186.612223] gitaly[1356]: time="2026-07-25T09:41:19.475Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD2SY5MC5XQYKYAD2GXH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:29.259" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:19.469" grpc.time_ms=6.442 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1986gitlab # [ 186.624736] gitaly[1356]: time="2026-07-25T09:41:19.481Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD2SGQNS0NGK7XR1866FQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4158 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:19.480" grpc.time_ms=0.267 pid=1356 span.kind=server system=grpc1987gitlab # [ 186.652147] gitaly[1356]: time="2026-07-25T09:41:19.515Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2VDZPQKPK8QA5S56W5A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:49.414" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:19.514" grpc.time_ms=1.35 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1988gitlab # [ 186.652917] gitaly[1356]: time="2026-07-25T09:41:19.516Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD2SGQNS0NGK7XR1866FQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4160 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:19.516" grpc.time_ms=0.208 pid=1356 span.kind=server system=grpc1989gitlab # [ 186.679901] gitaly[1356]: time="2026-07-25T09:41:19.543Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SGQNS0NGK7XR1866FQ diskcache=9bdbc23b-d1a7-47e2-b5d7-2f866421906a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T09:41:29.065" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:19.446" pid=1356 ref=refs/keep-around/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 remote_ip="2001:db8:1::1" revision=ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 span.kind=server system=grpc username=root1990gitlab # [ 186.680631] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:19.543Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"154f4b69bb5036173a782a2a","created_at":"2026-07-25T09:41:19.514Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-dd496c37fc59468f","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.540Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-154f4b69bb5036173a782a2a: start","job_status":"start","queue_duration_s":0.002874,"scheduling_latency_s":0.002904}1991gitlab # [ 186.681547] gitaly[1356]: time="2026-07-25T09:41:19.543Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=65 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5301 command.oublock=8 command.real_time_ms=88 command.spawn_token_fork_ms=0 command.system_time_ms=46 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SGQNS0NGK7XR1866FQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T09:41:29.065" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T09:41:19.446" grpc.time_ms=97.55 pid=1356 ref=refs/keep-around/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 remote_ip="2001:db8:1::1" revision=ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 span.kind=server system=grpc username=root1992gitlab # [ 186.683475] gitaly[1356]: time="2026-07-25T09:41:19.547Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SGQNS0NGK7XR1866FQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:49.546" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:19.546" grpc.time_ms=0.233 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1993gitlab # [ 186.744455] nixbot[2981]: {"ts": "2026-07-25T09:41:19.607Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1cad3f8dcab61599d4be7caef6e24d4ed336656d \"HTTP/1.1 201 Created\""}1994gitlab # [ 186.747450] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1cad3f8dcab61599d4be7caef6e24d4ed336656d HTTP/1.1" 201 651 "" "python-httpx/0.28.1" 3131995gitlab # [ 186.769554] gitaly[1356]: time="2026-07-25T09:41:19.633Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD2SY5MC5XQYKYAD2GXH1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3902 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:19.632" grpc.time_ms=0.295 pid=1356 span.kind=server system=grpc1996gitlab # [ 186.778716] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses HTTP/1.1" 200 2 "" "curl/8.20.0" 3001997gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses, in 0.33 seconds)1998gitlab # [ 186.799710] gitaly[1356]: time="2026-07-25T09:41:19.662Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD2SY5MC5XQYKYAD2GXH1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3900 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:19.661" grpc.time_ms=0.333 pid=1356 span.kind=server system=grpc1999gitlab # [ 186.809472] gitaly[1356]: time="2026-07-25T09:41:19.673Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD33XXFDMCFYDGW95SMPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:49.572" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:19.672" grpc.time_ms=0.495 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 186.821629] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3922001gitlab # [ 186.824162] nixbot[2981]: {"ts": "2026-07-25T09:41:19.674Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 \"HTTP/1.1 201 Created\""}2002gitlab # [ 186.826924] nixbot[2981]: {"ts": "2026-07-25T09:41:19.679Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-ef26aec7a6eb-8df42711", "argv0": "bwrap"}2003gitlab # [ 186.829346] gitaly[1356]: time="2026-07-25T09:41:19.689Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD2SY5MC5XQYKYAD2GXH1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3902 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:19.688" grpc.time_ms=0.747 pid=1356 span.kind=server system=grpc2004gitlab # [ 186.839093] gitaly[1356]: time="2026-07-25T09:41:19.701Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SY5MC5XQYKYAD2GXH1 diskcache=ceb25362-f92a-4d8f-b816-e2713889b869 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T09:41:49.505" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:19.605" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005gitlab # [ 186.839538] gitaly[1356]: time="2026-07-25T09:41:19.701Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=70 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7228 command.oublock=0 command.real_time_ms=86 command.spawn_token_fork_ms=5 command.system_time_ms=45 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SY5MC5XQYKYAD2GXH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T09:41:49.505" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:19.605" grpc.time_ms=96.057 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2006gitlab # [ 186.865064] gitaly[1356]: time="2026-07-25T09:41:19.728Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=21 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD33XXFDMCFYDGW95SMPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:29.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:19.701" grpc.time_ms=26.844 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2007gitlab # [ 186.909560] nix-daemon[3270]: accepted connection from pid 3416, user nixbot2008gitlab # [ 186.911847] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1cad3f8dcab61599d4be7caef6e24d4ed336656d HTTP/1.1" 201 665 "" "python-httpx/0.28.1" 1612009gitlab # [ 186.916031] nixbot[2981]: {"ts": "2026-07-25T09:41:19.776Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1cad3f8dcab61599d4be7caef6e24d4ed336656d \"HTTP/1.1 201 Created\""}2010gitlab # [ 186.924950] nix-daemon[3270]: accepted connection from pid 3419, user nixbot2011gitlab # [ 186.935605] gitaly[1356]: time="2026-07-25T09:41:19.799Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD2SY5MC5XQYKYAD2GXH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:41:49.697" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:19.798" grpc.time_ms=0.64 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2012gitlab # [ 186.965222] gitaly[1356]: time="2026-07-25T09:41:19.828Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SY5MC5XQYKYAD2GXH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:49.727" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:19.828" grpc.time_ms=0.416 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2013gitlab # [ 186.988244] gitaly[1356]: time="2026-07-25T09:41:19.851Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SY5MC5XQYKYAD2GXH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:49.751" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:19.851" grpc.time_ms=0.406 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2014gitlab # [ 186.996069] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:19.859Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"317120035851a7679ed1007f","created_at":"2026-07-25T09:41:19.857Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"154f4b69bb5036173a782a2a","job_size_bytes":3,"pid":2048,"job_status":"deduplicated","message":"PipelineProcessWorker JID-317120035851a7679ed1007f: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2015gitlab # [ 186.997150] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:19.860Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"154f4b69bb5036173a782a2a","created_at":"2026-07-25T09:41:19.514Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-dd496c37fc59468f","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.540Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2048,"job_status":"rescheduled","message":"PipelineProcessWorker JID-154f4b69bb5036173a782a2a: rescheduled"}2016gitlab # [ 187.002138] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:19.865Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"154f4b69bb5036173a782a2a","created_at":"2026-07-25T09:41:19.514Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-dd496c37fc59468f","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.540Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-154f4b69bb5036173a782a2a: done: 0.322324 sec","job_status":"done","queue_duration_s":0.002874,"scheduling_latency_s":0.002904,"gitaly_calls":4,"gitaly_duration_s":0.114801,"redis_calls":104,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.023102,"redis_read_bytes":267,"redis_write_bytes":24008,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000625,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":17,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.00108,"redis_cache_read_bytes":33,"redis_cache_write_bytes":1526,"redis_feature_flag_calls":22,"redis_feature_flag_duration_s":0.004514,"redis_feature_flag_read_bytes":22,"redis_feature_flag_write_bytes":3871,"redis_queues_calls":22,"redis_queues_duration_s":0.006459,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12387,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.007582,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000266,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000349,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001602,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":850,"db_count":47,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.152525,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.297899034,"duration_s":0.322324,"completed_at":"2026-07-25T09:41:19.865Z","load_balancing_strategy":"primary","db_duration_s":0.041558,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2017gitlab # [ 187.044920] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:19.866Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4fb5326fa95eaebd587111a2","created_at":"2026-07-25T09:41:19.551Z","trace_propagation_headers":{"sentry-trace":"3e739d77221944489b221f99652ee49a-6f0d6390a8064f99","baggage":"sentry-trace_id=3e739d77221944489b221f99652ee49a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD2SGQNS0NGK7XR1866FQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.554Z","job_size_bytes":65,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4fb5326fa95eaebd587111a2: start","job_status":"start","queue_duration_s":0.311502,"scheduling_latency_s":0.311516}2018gitlab # [ 187.049095] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:19.882Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4fb5326fa95eaebd587111a2","created_at":"2026-07-25T09:41:19.551Z","trace_propagation_headers":{"sentry-trace":"3e739d77221944489b221f99652ee49a-6f0d6390a8064f99","baggage":"sentry-trace_id=3e739d77221944489b221f99652ee49a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD2SGQNS0NGK7XR1866FQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.554Z","job_size_bytes":65,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4fb5326fa95eaebd587111a2: done: 0.016015 sec","job_status":"done","queue_duration_s":0.311502,"scheduling_latency_s":0.311516,"redis_calls":7,"redis_duration_s":0.00094,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016015,"completed_at":"2026-07-25T09:41:19.882Z","load_balancing_strategy":"primary","db_duration_s":0.002574,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2019gitlab # [ 187.099322] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:19.883Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"8e33650eed72f91547c4b7b0","created_at":"2026-07-25T09:41:19.556Z","trace_propagation_headers":{"sentry-trace":"3e739d77221944489b221f99652ee49a-6f0d6390a8064f99","baggage":"sentry-trace_id=3e739d77221944489b221f99652ee49a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD2SGQNS0NGK7XR1866FQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.558Z","job_size_bytes":65,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-8e33650eed72f91547c4b7b0: start","job_status":"start","queue_duration_s":0.324948,"scheduling_latency_s":0.324963}2020gitlab # [ 187.103447] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:19.923Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"8e33650eed72f91547c4b7b0","created_at":"2026-07-25T09:41:19.556Z","trace_propagation_headers":{"sentry-trace":"3e739d77221944489b221f99652ee49a-6f0d6390a8064f99","baggage":"sentry-trace_id=3e739d77221944489b221f99652ee49a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD2SGQNS0NGK7XR1866FQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.558Z","job_size_bytes":65,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-8e33650eed72f91547c4b7b0: done: 0.039789 sec","job_status":"done","queue_duration_s":0.324948,"scheduling_latency_s":0.324963,"redis_calls":10,"redis_duration_s":0.001872,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039789,"completed_at":"2026-07-25T09:41:19.923Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013546,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2021gitlab # [ 187.159479] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:19.925Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"af9db4fb7cdd6683d528efa4","created_at":"2026-07-25T09:41:19.594Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.599Z","job_size_bytes":23,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-af9db4fb7cdd6683d528efa4: start","job_status":"start","queue_duration_s":0.326502,"scheduling_latency_s":0.326533}2022gitlab # [ 187.160782] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.022Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"af9db4fb7cdd6683d528efa4","created_at":"2026-07-25T09:41:19.594Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.599Z","job_size_bytes":23,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-af9db4fb7cdd6683d528efa4: done: 0.096936 sec","job_status":"done","queue_duration_s":0.326502,"scheduling_latency_s":0.326533,"redis_calls":15,"redis_duration_s":0.002368,"redis_read_bytes":13,"redis_write_bytes":3011,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_calls":2,"redis_queues_duration_s":0.000202,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1626,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":742,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000649,"redis_rate_limiting_write_bytes":148,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":13,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":13,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07262,"worker_id":"sidekiq_0","rate_limiting_gates":["permanent_email_failure","temporary_email_failure"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000190527,"duration_s":0.096936,"completed_at":"2026-07-25T09:41:20.022Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015611,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2023gitlab # [ 187.238802] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.023Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0b03cd7c995ce023a745f0f4","created_at":"2026-07-25T09:41:19.655Z","trace_propagation_headers":{"sentry-trace":"3e739d77221944489b221f99652ee49a-6f0d6390a8064f99","baggage":"sentry-trace_id=3e739d77221944489b221f99652ee49a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD2SGQNS0NGK7XR1866FQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.658Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0b03cd7c995ce023a745f0f4: start","job_status":"start","queue_duration_s":0.364893,"scheduling_latency_s":0.364908}2024gitlab # [ 187.239882] gitaly[1356]: time="2026-07-25T09:41:20.064Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD2SGQNS0NGK7XR1866FQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:41:50.063" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:20.063" grpc.time_ms=0.559 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2025gitlab # [ 187.240897] gitaly[1356]: time="2026-07-25T09:41:20.088Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SGQNS0NGK7XR1866FQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:50.087" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:20.088" grpc.time_ms=0.429 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2026gitlab # [ 187.241951] gitaly[1356]: time="2026-07-25T09:41:20.105Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SGQNS0NGK7XR1866FQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:50.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:20.105" grpc.time_ms=0.319 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2027gitlab # [ 187.250774] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.111Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0b03cd7c995ce023a745f0f4","created_at":"2026-07-25T09:41:19.655Z","trace_propagation_headers":{"sentry-trace":"3e739d77221944489b221f99652ee49a-6f0d6390a8064f99","baggage":"sentry-trace_id=3e739d77221944489b221f99652ee49a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD2SGQNS0NGK7XR1866FQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.658Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0b03cd7c995ce023a745f0f4: done: 0.088539 sec","job_status":"done","queue_duration_s":0.364893,"scheduling_latency_s":0.364908,"gitaly_calls":3,"gitaly_duration_s":0.005443,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.004881,"redis_read_bytes":99,"redis_write_bytes":6014,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000555,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.00161,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000162,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000145,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000374,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000566,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":31,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":31,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065377,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.074793025,"duration_s":0.088539,"completed_at":"2026-07-25T09:41:20.111Z","load_balancing_strategy":"primary","db_duration_s":0.01823,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2028gitlab # [ 187.297918] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.113Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"523fcfb5e8f4b9618339fff6","created_at":"2026-07-25T09:41:19.725Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.730Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-523fcfb5e8f4b9618339fff6: start","job_status":"start","queue_duration_s":0.382415,"scheduling_latency_s":0.382429}2029gitlab # [ 187.345526] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.130Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"523fcfb5e8f4b9618339fff6","created_at":"2026-07-25T09:41:19.725Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.730Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-523fcfb5e8f4b9618339fff6: done: 0.017303 sec","job_status":"done","queue_duration_s":0.382415,"scheduling_latency_s":0.382429,"redis_calls":10,"redis_duration_s":0.001485,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000529,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196394,"duration_s":0.017303,"completed_at":"2026-07-25T09:41:20.130Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2030gitlab # [ 187.353170] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.131Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"13a05f4e2569daf313bd63c3","created_at":"2026-07-25T09:41:20.015Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-1d93346e7a434552","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:bfc053650a52c592f9772d6e885b67456513f4dbe9b7afb17c08be8e9130e8d7","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:20.016Z","job_size_bytes":464,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-13a05f4e2569daf313bd63c3: start","job_status":"start","queue_duration_s":0.114184,"scheduling_latency_s":0.114197}2031gitlab # [ 187.368943] sidekiq-cluster[2048]: {"severity":"WARN","time":"2026-07-25T09:41:20.156Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"13a05f4e2569daf313bd63c3","created_at":"2026-07-25T09:41:20.015Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-1d93346e7a434552","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:bfc053650a52c592f9772d6e885b67456513f4dbe9b7afb17c08be8e9130e8d7","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:20.016Z","job_size_bytes":464,"pid":2048,"sidekiq_tid":"m41g","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-13a05f4e2569daf313bd63c3: fail: 0.024236 sec","job_status":"fail","queue_duration_s":0.114184,"scheduling_latency_s":0.114197,"redis_calls":7,"redis_duration_s":0.001455,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024236,"completed_at":"2026-07-25T09:41:20.155Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/pipelines.rb:33:in `pipeline_mail'","app/mailers/emails/pipelines.rb:10:in `pipeline_failed_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.003339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2032gitlab # [ 187.744165] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.158Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"be98c3aece1c91e69bd2723b","created_at":"2026-07-25T09:41:19.751Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.756Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-be98c3aece1c91e69bd2723b: start","job_status":"start","queue_duration_s":0.401939,"scheduling_latency_s":0.40197}2033gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses2034gitlab # [ 187.745145] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.201Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"be98c3aece1c91e69bd2723b","created_at":"2026-07-25T09:41:19.751Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.756Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-be98c3aece1c91e69bd2723b: done: 0.043046 sec","job_status":"done","queue_duration_s":0.401939,"scheduling_latency_s":0.40197,"redis_calls":10,"redis_duration_s":0.001519,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000301,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217905,"duration_s":0.043046,"completed_at":"2026-07-25T09:41:20.201Z","load_balancing_strategy":"primary","db_duration_s":0.021777,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2035gitlab # [ 187.787879] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.202Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2ef36212dea31711405789ea","created_at":"2026-07-25T09:41:19.767Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.771Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2ef36212dea31711405789ea: start","job_status":"start","queue_duration_s":0.430596,"scheduling_latency_s":0.43061}2036gitlab # [ 187.788945] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.221Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2ef36212dea31711405789ea","created_at":"2026-07-25T09:41:19.767Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.771Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2ef36212dea31711405789ea: done: 0.019304 sec","job_status":"done","queue_duration_s":0.430596,"scheduling_latency_s":0.43061,"redis_calls":13,"redis_duration_s":0.0015999999999999999,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000752,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00035,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191924,"duration_s":0.019304,"completed_at":"2026-07-25T09:41:20.221Z","load_balancing_strategy":"primary","db_duration_s":0.002158,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2037gitlab # [ 187.828209] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.222Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"53de58a3bea0ada6304eae3f","created_at":"2026-07-25T09:41:19.771Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.775Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-53de58a3bea0ada6304eae3f: start","job_status":"start","queue_duration_s":0.446882,"scheduling_latency_s":0.446895}2038gitlab # [ 187.828843] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.238Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"53de58a3bea0ada6304eae3f","created_at":"2026-07-25T09:41:19.771Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.775Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-53de58a3bea0ada6304eae3f: done: 0.016782 sec","job_status":"done","queue_duration_s":0.446882,"scheduling_latency_s":0.446895,"redis_calls":10,"redis_duration_s":0.001324,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000827,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000193041,"duration_s":0.016782,"completed_at":"2026-07-25T09:41:20.238Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2039gitlab # [ 187.871047] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.239Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4684e507a6fac524d8d9292e","created_at":"2026-07-25T09:41:19.778Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.784Z","job_size_bytes":19,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4684e507a6fac524d8d9292e: start","job_status":"start","queue_duration_s":0.454976,"scheduling_latency_s":0.454996}2040gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses, in 0.16 seconds)2041gitlab # [ 187.909250] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.257Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4684e507a6fac524d8d9292e","created_at":"2026-07-25T09:41:19.778Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.784Z","job_size_bytes":19,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4684e507a6fac524d8d9292e: done: 0.017438 sec","job_status":"done","queue_duration_s":0.454976,"scheduling_latency_s":0.454996,"redis_calls":11,"redis_duration_s":0.001363,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000874,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000185499,"duration_s":0.017438,"completed_at":"2026-07-25T09:41:20.257Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002158,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2042gitlab # [ 187.915404] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.258Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"cc0eeaca3371a75a8649c02b","created_at":"2026-07-25T09:41:19.787Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.791Z","job_size_bytes":65,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-cc0eeaca3371a75a8649c02b: start","job_status":"start","queue_duration_s":0.46644,"scheduling_latency_s":0.466453}2043gitlab # [ 187.930919] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.286Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"cc0eeaca3371a75a8649c02b","created_at":"2026-07-25T09:41:19.787Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.791Z","job_size_bytes":65,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-cc0eeaca3371a75a8649c02b: done: 0.027994 sec","job_status":"done","queue_duration_s":0.46644,"scheduling_latency_s":0.466453,"redis_calls":10,"redis_duration_s":0.0019039999999999999,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000384,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362336,"duration_s":0.027994,"completed_at":"2026-07-25T09:41:20.286Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002617,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2044gitlab # [ 187.978987] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.287Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"0a98f80c2598516dcf3192a6","created_at":"2026-07-25T09:41:19.792Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.793Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0a98f80c2598516dcf3192a6: start","job_status":"start","queue_duration_s":0.494441,"scheduling_latency_s":0.49447}2045gitlab # [ 187.984564] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.317Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"0a98f80c2598516dcf3192a6","created_at":"2026-07-25T09:41:19.792Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.793Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0a98f80c2598516dcf3192a6: done: 0.029707 sec","job_status":"done","queue_duration_s":0.494441,"scheduling_latency_s":0.49447,"redis_calls":7,"redis_duration_s":0.0013650000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00034,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029707,"completed_at":"2026-07-25T09:41:20.317Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2046gitlab # [ 188.023943] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.318Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"b967f1aaae1be922d19e6edd","created_at":"2026-07-25T09:41:19.829Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.832Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b967f1aaae1be922d19e6edd: start","job_status":"start","queue_duration_s":0.486506,"scheduling_latency_s":0.486541}2047gitlab # [ 188.063773] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.339Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"b967f1aaae1be922d19e6edd","created_at":"2026-07-25T09:41:19.829Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.832Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b967f1aaae1be922d19e6edd: done: 0.020608 sec","job_status":"done","queue_duration_s":0.486506,"scheduling_latency_s":0.486541,"redis_calls":10,"redis_duration_s":0.001443,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000316,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000835,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000223492,"duration_s":0.020608,"completed_at":"2026-07-25T09:41:20.339Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2048gitlab # [ 188.073846] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.340Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b1f9f8f1381639f98edbedc0","created_at":"2026-07-25T09:41:19.832Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.835Z","job_size_bytes":6,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b1f9f8f1381639f98edbedc0: start","job_status":"start","queue_duration_s":0.505079,"scheduling_latency_s":0.505092}2049gitlab # [ 188.114751] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.353Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b1f9f8f1381639f98edbedc0","created_at":"2026-07-25T09:41:19.832Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.835Z","job_size_bytes":6,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b1f9f8f1381639f98edbedc0: done: 0.013781 sec","job_status":"done","queue_duration_s":0.505079,"scheduling_latency_s":0.505092,"redis_calls":10,"redis_duration_s":0.0012590000000000001,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000192762,"duration_s":0.013781,"completed_at":"2026-07-25T09:41:20.353Z","load_balancing_strategy":"primary","db_duration_s":0.001592,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2050gitlab # [ 188.156704] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.354Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"78d1bdbccb325f4791997683","created_at":"2026-07-25T09:41:19.860Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.861Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-78d1bdbccb325f4791997683: start","job_status":"start","queue_duration_s":0.493009,"scheduling_latency_s":0.493022}2051gitlab # [ 188.157540] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.404Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"78d1bdbccb325f4791997683","created_at":"2026-07-25T09:41:19.860Z","trace_propagation_headers":{"sentry-trace":"91df4c2a087244db942320c6ab0457c9-173d1be8bbc74103","baggage":"sentry-trace_id=91df4c2a087244db942320c6ab0457c9,sentry-release=Unknown"},"correlation_id":"01KYCAD2SY5MC5XQYKYAD2GXH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:19.861Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-78d1bdbccb325f4791997683: done: 0.050087 sec","job_status":"done","queue_duration_s":0.493009,"scheduling_latency_s":0.493022,"gitaly_calls":2,"gitaly_duration_s":0.004607,"redis_calls":19,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.002007,"redis_read_bytes":42,"redis_write_bytes":1891,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000418,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000129,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000615,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":20,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":20,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":9,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.036891281,"duration_s":0.050087,"completed_at":"2026-07-25T09:41:20.404Z","load_balancing_strategy":"primary","db_duration_s":0.009908,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2052gitlab # [ 188.180034] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.405Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c5d16efc55feb3ec983f4798","created_at":"2026-07-25T09:41:20.056Z","trace_propagation_headers":{"sentry-trace":"3e739d77221944489b221f99652ee49a-337c38e24e30433d","baggage":"sentry-trace_id=3e739d77221944489b221f99652ee49a,sentry-release=Unknown"},"correlation_id":"01KYCAD2SGQNS0NGK7XR1866FQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:20.057Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c5d16efc55feb3ec983f4798: start","job_status":"start","queue_duration_s":0.348538,"scheduling_latency_s":0.348552}2053gitlab # [ 188.194622] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:20.422Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c5d16efc55feb3ec983f4798","created_at":"2026-07-25T09:41:20.056Z","trace_propagation_headers":{"sentry-trace":"3e739d77221944489b221f99652ee49a-337c38e24e30433d","baggage":"sentry-trace_id=3e739d77221944489b221f99652ee49a,sentry-release=Unknown"},"correlation_id":"01KYCAD2SGQNS0NGK7XR1866FQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:20.057Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c5d16efc55feb3ec983f4798: done: 0.01669 sec","job_status":"done","queue_duration_s":0.348538,"scheduling_latency_s":0.348552,"redis_calls":7,"redis_duration_s":0.0009480000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000306,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01669,"completed_at":"2026-07-25T09:41:20.422Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001857,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2054gitlab # [ 188.237887] gitaly[1356]: time="2026-07-25T09:41:20.379Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD2SY5MC5XQYKYAD2GXH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:41:50.277" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:20.378" grpc.time_ms=1.01 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab # [ 188.242906] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 452056gitlab # [ 188.245025] gitaly[1356]: time="2026-07-25T09:41:20.398Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD2SY5MC5XQYKYAD2GXH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:50.297" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:20.398" grpc.time_ms=0.385 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2057gitlab # [ 188.291845] gitaly[1356]: time="2026-07-25T09:41:20.788Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD47PPZXT90G1Q20JBKF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:50.687" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:20.788" grpc.time_ms=0.604 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2058gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses2059gitlab # [ 189.078501] gitaly[1356]: time="2026-07-25T09:41:21.942Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD59VRZMFHDHSW201YR8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:51.840" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:21.940" grpc.time_ms=0.847 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2060gitlab # [ 189.109152] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1212061gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses, in 0.17 seconds)2062gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses2063gitlab # [ 190.210584] gitaly[1356]: time="2026-07-25T09:41:23.073Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD6E8KH6VW5S73E6FSPEF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:53.071" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:23.072" grpc.time_ms=0.904 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2064gitlab # [ 190.261683] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1072065gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses, in 0.15 seconds)2066gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses2067gitlab # [ 191.373917] gitaly[1356]: time="2026-07-25T09:41:24.236Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD7J60MY3KXXXSHD3AVRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:54.235" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:24.235" grpc.time_ms=0.969 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068gitlab # [ 191.410960] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1062069gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses, in 0.15 seconds)2070gitlab # [ 191.702714] nix-daemon[3270]: accepted connection from pid 3455, user nixbot2071gitlab # [ 191.740955] gitaly[1356]: time="2026-07-25T09:41:24.604Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD7XQPJ4BFE5WF3630S1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:54.602" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:24.603" grpc.time_ms=0.8 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab # [ 191.780615] gitaly[1356]: time="2026-07-25T09:41:24.644Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD7XQPJ4BFE5WF3630S1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:34.256" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:24.637" grpc.time_ms=6.824 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2073gitlab # [ 191.816756] nixbot[2981]: {"ts": "2026-07-25T09:41:24.678Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 \"HTTP/1.1 201 Created\""}2074gitlab # [ 191.824409] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1522075gitlab # [ 191.842145] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:24.705Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"6ca95963db8f715f2e7a6eec","created_at":"2026-07-25T09:41:24.664Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-504eef6813a543de","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.666Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6ca95963db8f715f2e7a6eec: start","job_status":"start","queue_duration_s":0.038929,"scheduling_latency_s":0.038962}2076gitlab # [ 191.857965] gitaly[1356]: time="2026-07-25T09:41:24.721Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD82FAEGCCG5BYJEAM6QC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:54.720" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:24.720" grpc.time_ms=0.709 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077gitlab # [ 191.882547] gitaly[1356]: time="2026-07-25T09:41:24.746Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD82FAEGCCG5BYJEAM6QC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:34.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:24.741" grpc.time_ms=5.014 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2078gitlab # [ 191.911443] gitaly[1356]: time="2026-07-25T09:41:24.775Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD7XQPJ4BFE5WF3630S1F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3902 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:24.774" grpc.time_ms=0.291 pid=1356 span.kind=server system=grpc2079gitlab # [ 191.915275] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 902080gitlab # [ 191.916069] nixbot[2981]: {"ts": "2026-07-25T09:41:24.778Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 \"HTTP/1.1 201 Created\""}2081gitlab # [ 191.941827] gitaly[1356]: time="2026-07-25T09:41:24.805Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD7XQPJ4BFE5WF3630S1F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3900 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:24.805" grpc.time_ms=0.372 pid=1356 span.kind=server system=grpc2082gitlab # [ 191.969268] gitaly[1356]: time="2026-07-25T09:41:24.832Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCAD7XQPJ4BFE5WF3630S1F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3902 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:24.832" grpc.time_ms=0.281 pid=1356 span.kind=server system=grpc2083gitlab # [ 191.978741] gitaly[1356]: time="2026-07-25T09:41:24.842Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD7XQPJ4BFE5WF3630S1F diskcache=6af25e60-95db-4d5a-9a9c-81b10fb55e72 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T09:41:54.656" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:24.756" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 191.979068] gitaly[1356]: time="2026-07-25T09:41:24.842Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=60 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7186 command.oublock=0 command.real_time_ms=78 command.spawn_token_fork_ms=0 command.system_time_ms=37 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD7XQPJ4BFE5WF3630S1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T09:41:54.656" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:24.756" grpc.time_ms=85.905 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab # [ 192.007035] gitaly[1356]: time="2026-07-25T09:41:24.870Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD7XQPJ4BFE5WF3630S1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:41:54.769" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:24.870" grpc.time_ms=0.508 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 192.038582] gitaly[1356]: time="2026-07-25T09:41:24.902Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD7XQPJ4BFE5WF3630S1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:54.801" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:24.901" grpc.time_ms=0.56 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 192.082897] gitaly[1356]: time="2026-07-25T09:41:24.946Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD7XQPJ4BFE5WF3630S1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:54.845" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:24.945" grpc.time_ms=0.484 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 192.089788] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:24.953Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"643019290d41ddb2c0fef989","created_at":"2026-07-25T09:41:24.951Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"6ca95963db8f715f2e7a6eec","job_size_bytes":3,"pid":2048,"job_status":"deduplicated","message":"PipelineProcessWorker JID-643019290d41ddb2c0fef989: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2089gitlab # [ 192.090980] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:24.954Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"6ca95963db8f715f2e7a6eec","created_at":"2026-07-25T09:41:24.664Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-504eef6813a543de","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.666Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2048,"job_status":"rescheduled","message":"PipelineProcessWorker JID-6ca95963db8f715f2e7a6eec: rescheduled"}2090gitlab # [ 192.095632] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:24.959Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"6ca95963db8f715f2e7a6eec","created_at":"2026-07-25T09:41:24.664Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-504eef6813a543de","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.666Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6ca95963db8f715f2e7a6eec: done: 0.253904 sec","job_status":"done","queue_duration_s":0.038929,"scheduling_latency_s":0.038962,"gitaly_calls":4,"gitaly_duration_s":0.115242,"redis_calls":93,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.013757,"redis_read_bytes":262,"redis_write_bytes":23389,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00082,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002325,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00083,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":712,"redis_queues_calls":25,"redis_queues_duration_s":0.002736,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14470,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.004528,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000134,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000315,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001249,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":38,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":38,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":23,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.113197,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.232387357,"duration_s":0.253904,"completed_at":"2026-07-25T09:41:24.959Z","load_balancing_strategy":"primary","db_duration_s":0.029544,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2091gitlab # [ 192.132181] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:24.960Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"938ec78be658cd117b550a3f","created_at":"2026-07-25T09:41:24.750Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.751Z","job_size_bytes":23,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-938ec78be658cd117b550a3f: start","job_status":"start","queue_duration_s":0.2084,"scheduling_latency_s":0.208416}2092gitlab # [ 192.175660] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:24.986Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"938ec78be658cd117b550a3f","created_at":"2026-07-25T09:41:24.750Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.751Z","job_size_bytes":23,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-938ec78be658cd117b550a3f: done: 0.025957 sec","job_status":"done","queue_duration_s":0.2084,"scheduling_latency_s":0.208416,"redis_calls":7,"redis_duration_s":0.001577,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001144,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000433,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025957,"completed_at":"2026-07-25T09:41:24.986Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006759,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2093gitlab # [ 192.182044] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:24.987Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d48ad89b28ace64d6c86217e","created_at":"2026-07-25T09:41:24.846Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.848Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d48ad89b28ace64d6c86217e: start","job_status":"start","queue_duration_s":0.139097,"scheduling_latency_s":0.139113}2094gitlab # [ 192.220288] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.002Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d48ad89b28ace64d6c86217e","created_at":"2026-07-25T09:41:24.846Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.848Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d48ad89b28ace64d6c86217e: done: 0.014899 sec","job_status":"done","queue_duration_s":0.139097,"scheduling_latency_s":0.139113,"redis_calls":7,"redis_duration_s":0.0014750000000000002,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001082,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014899,"completed_at":"2026-07-25T09:41:25.002Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2095gitlab # [ 192.233690] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.003Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"95ccd4f3727675fc306cca1f","created_at":"2026-07-25T09:41:24.853Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.854Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-95ccd4f3727675fc306cca1f: start","job_status":"start","queue_duration_s":0.149171,"scheduling_latency_s":0.149185}2096gitlab # [ 192.281573] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.023Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"95ccd4f3727675fc306cca1f","created_at":"2026-07-25T09:41:24.853Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.854Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-95ccd4f3727675fc306cca1f: done: 0.020108 sec","job_status":"done","queue_duration_s":0.149171,"scheduling_latency_s":0.149185,"redis_calls":7,"redis_duration_s":0.001613,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000417,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020108,"completed_at":"2026-07-25T09:41:25.023Z","load_balancing_strategy":"primary","db_duration_s":0.006783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2097gitlab # [ 192.283777] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.024Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"72c5fb750b8a1834c3384c57","created_at":"2026-07-25T09:41:24.858Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.859Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-72c5fb750b8a1834c3384c57: start","job_status":"start","queue_duration_s":0.165093,"scheduling_latency_s":0.165107}2098gitlab # [ 192.298543] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.042Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"72c5fb750b8a1834c3384c57","created_at":"2026-07-25T09:41:24.858Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.859Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-72c5fb750b8a1834c3384c57: done: 0.017742 sec","job_status":"done","queue_duration_s":0.165093,"scheduling_latency_s":0.165107,"redis_calls":10,"redis_duration_s":0.002149,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000671,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000424,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017742,"completed_at":"2026-07-25T09:41:25.042Z","load_balancing_strategy":"primary","db_duration_s":0.003877,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2099gitlab # [ 192.361244] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.043Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7c920bf8e573e74860d0c33d","created_at":"2026-07-25T09:41:24.860Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.861Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7c920bf8e573e74860d0c33d: start","job_status":"start","queue_duration_s":0.182632,"scheduling_latency_s":0.182646}2100gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses2101gitlab # [ 192.362262] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.059Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7c920bf8e573e74860d0c33d","created_at":"2026-07-25T09:41:24.860Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.861Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7c920bf8e573e74860d0c33d: done: 0.015582 sec","job_status":"done","queue_duration_s":0.182632,"scheduling_latency_s":0.182646,"redis_calls":7,"redis_duration_s":0.001595,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001197,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000398,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015582,"completed_at":"2026-07-25T09:41:25.059Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2102gitlab # [ 192.412432] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.060Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"94eaabe89ed0b1145d62684d","created_at":"2026-07-25T09:41:24.861Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.862Z","job_size_bytes":19,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-94eaabe89ed0b1145d62684d: start","job_status":"start","queue_duration_s":0.197712,"scheduling_latency_s":0.197725}2103gitlab # [ 192.413549] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.076Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"94eaabe89ed0b1145d62684d","created_at":"2026-07-25T09:41:24.861Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.862Z","job_size_bytes":19,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-94eaabe89ed0b1145d62684d: done: 0.015812 sec","job_status":"done","queue_duration_s":0.197712,"scheduling_latency_s":0.197725,"redis_calls":8,"redis_duration_s":0.0017,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001313,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015812,"completed_at":"2026-07-25T09:41:25.076Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003517,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2104gitlab # [ 192.466557] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.077Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"50e81f7d3d38871e31e12590","created_at":"2026-07-25T09:41:24.863Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.864Z","job_size_bytes":66,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-50e81f7d3d38871e31e12590: start","job_status":"start","queue_duration_s":0.212676,"scheduling_latency_s":0.212691}2105gitlab # [ 192.467836] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.089Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"50e81f7d3d38871e31e12590","created_at":"2026-07-25T09:41:24.863Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.864Z","job_size_bytes":66,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-50e81f7d3d38871e31e12590: done: 0.012139 sec","job_status":"done","queue_duration_s":0.212676,"scheduling_latency_s":0.212691,"redis_calls":7,"redis_duration_s":0.0018639999999999998,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000788,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012139,"completed_at":"2026-07-25T09:41:25.089Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001601,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2106gitlab # [ 192.510728] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.090Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"cced38e8c074a50831ded1ff","created_at":"2026-07-25T09:41:24.865Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.866Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-cced38e8c074a50831ded1ff: start","job_status":"start","queue_duration_s":0.224261,"scheduling_latency_s":0.224273}2107gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses, in 0.16 seconds)2108gitlab # [ 192.513255] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.109Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"cced38e8c074a50831ded1ff","created_at":"2026-07-25T09:41:24.865Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.866Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-cced38e8c074a50831ded1ff: done: 0.019183 sec","job_status":"done","queue_duration_s":0.224261,"scheduling_latency_s":0.224273,"redis_calls":7,"redis_duration_s":0.001597,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001176,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000421,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019183,"completed_at":"2026-07-25T09:41:25.109Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003762,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2109gitlab # [ 192.569495] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.110Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"03f5f08895f8ed51c6d6514e","created_at":"2026-07-25T09:41:24.918Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.919Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-03f5f08895f8ed51c6d6514e: start","job_status":"start","queue_duration_s":0.191041,"scheduling_latency_s":0.191055}2110gitlab # [ 192.570575] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.125Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"03f5f08895f8ed51c6d6514e","created_at":"2026-07-25T09:41:24.918Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.919Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-03f5f08895f8ed51c6d6514e: done: 0.0147 sec","job_status":"done","queue_duration_s":0.191041,"scheduling_latency_s":0.191055,"redis_calls":7,"redis_duration_s":0.001493,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0147,"completed_at":"2026-07-25T09:41:25.125Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00393,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2111gitlab # [ 192.604184] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.126Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"fc2129c86ed839747f63d097","created_at":"2026-07-25T09:41:24.920Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.921Z","job_size_bytes":6,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-fc2129c86ed839747f63d097: start","job_status":"start","queue_duration_s":0.205497,"scheduling_latency_s":0.20551}2112gitlab # [ 192.646243] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.135Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"fc2129c86ed839747f63d097","created_at":"2026-07-25T09:41:24.920Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.921Z","job_size_bytes":6,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-fc2129c86ed839747f63d097: done: 0.009131 sec","job_status":"done","queue_duration_s":0.205497,"scheduling_latency_s":0.20551,"redis_calls":7,"redis_duration_s":0.0015769999999999998,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001135,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000442,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009131,"completed_at":"2026-07-25T09:41:25.135Z","load_balancing_strategy":"primary","db_duration_s":0.000427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2113gitlab # [ 192.688204] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.136Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"33c1ac169d5cdf747418f345","created_at":"2026-07-25T09:41:24.921Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.924Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-33c1ac169d5cdf747418f345: start","job_status":"start","queue_duration_s":0.212871,"scheduling_latency_s":0.212885}2114gitlab # [ 192.688907] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.159Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"33c1ac169d5cdf747418f345","created_at":"2026-07-25T09:41:24.921Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.924Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-33c1ac169d5cdf747418f345: done: 0.022215 sec","job_status":"done","queue_duration_s":0.212871,"scheduling_latency_s":0.212885,"redis_calls":10,"redis_duration_s":0.002508,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000581,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001374,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000553,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000281041,"duration_s":0.022215,"completed_at":"2026-07-25T09:41:25.159Z","load_balancing_strategy":"primary","db_duration_s":0.006237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2115gitlab # [ 192.704860] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.160Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"39dd2bac864207ef241be014","created_at":"2026-07-25T09:41:24.954Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.955Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-39dd2bac864207ef241be014: start","job_status":"start","queue_duration_s":0.204672,"scheduling_latency_s":0.204686}2116gitlab # [ 192.744779] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.265Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"39dd2bac864207ef241be014","created_at":"2026-07-25T09:41:24.954Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-58a2636a36884c9f","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:24.955Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-39dd2bac864207ef241be014: done: 0.105158 sec","job_status":"done","queue_duration_s":0.204672,"scheduling_latency_s":0.204686,"gitaly_calls":3,"gitaly_duration_s":0.009314,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007521,"redis_read_bytes":98,"redis_write_bytes":6013,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000972,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001884,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000284,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001669,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000244,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000461,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":20,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058218,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08804918,"duration_s":0.105158,"completed_at":"2026-07-25T09:41:25.265Z","load_balancing_strategy":"primary","db_duration_s":0.035434,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2117gitlab # [ 192.763173] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.266Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"22a11eae34d42c2910f430f1","created_at":"2026-07-25T09:41:25.199Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-39c12350f53f43c2","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:25.201Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-22a11eae34d42c2910f430f1: start","job_status":"start","queue_duration_s":0.065624,"scheduling_latency_s":0.065638}2118gitlab # [ 192.777649] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:25.286Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"22a11eae34d42c2910f430f1","created_at":"2026-07-25T09:41:25.199Z","trace_propagation_headers":{"sentry-trace":"cc9c7a65f07f42bbbd8fa949d0fecf52-39c12350f53f43c2","baggage":"sentry-trace_id=cc9c7a65f07f42bbbd8fa949d0fecf52,sentry-release=Unknown"},"correlation_id":"01KYCAD7XQPJ4BFE5WF3630S1F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:25.201Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-22a11eae34d42c2910f430f1: done: 0.020063 sec","job_status":"done","queue_duration_s":0.065624,"scheduling_latency_s":0.065638,"redis_calls":7,"redis_duration_s":0.001769,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001202,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000567,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020063,"completed_at":"2026-07-25T09:41:25.286Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004021,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2119gitlab # [ 192.832362] gitaly[1356]: time="2026-07-25T09:41:25.210Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCAD7XQPJ4BFE5WF3630S1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:41:55.108" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:25.208" grpc.time_ms=1.393 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab # [ 192.833217] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 502121gitlab # [ 192.833456] gitaly[1356]: time="2026-07-25T09:41:25.233Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD7XQPJ4BFE5WF3630S1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:55.131" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:25.232" grpc.time_ms=0.785 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 192.874752] gitaly[1356]: time="2026-07-25T09:41:25.256Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD7XQPJ4BFE5WF3630S1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:55.154" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:25.254" grpc.time_ms=0.939 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 192.875598] gitaly[1356]: time="2026-07-25T09:41:25.417Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD8R9E21CMJEANY7F4XQT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:55.415" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:25.416" grpc.time_ms=0.82 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses2125gitlab # [ 193.675453] gitaly[1356]: time="2026-07-25T09:41:26.538Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCAD9TKRZV4N2ZXYM5QHJZ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:56.537" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:26.537" grpc.time_ms=0.812 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 193.731672] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 1112127gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses, in 0.16 seconds)2128gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses2129gitlab # [ 194.830179] gitaly[1356]: time="2026-07-25T09:41:27.692Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCADAYMHQJPG45KDVFEM6J0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:57.591" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:27.691" grpc.time_ms=0.808 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 194.890223] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 1152131gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses, in 0.16 seconds)2132gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses2133gitlab # [ 195.987761] gitaly[1356]: time="2026-07-25T09:41:28.850Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCADC2V0DMA8JHDYH0Y87ZX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:58.048" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:28.849" grpc.time_ms=0.912 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 196.022637] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 902135gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses, in 0.13 seconds)2136gitlab # [ 196.286663] nix-daemon[3270]: accepted connection from pid 3531, user nixbot2137gitlab # [ 196.348085] gitaly[1356]: time="2026-07-25T09:41:29.211Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:59.210" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:29.210" grpc.time_ms=0.736 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 196.400942] gitaly[1356]: time="2026-07-25T09:41:29.264Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T09:41:39.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:29.254" grpc.time_ms=9.445 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2139gitlab # [ 196.439467] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.300Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f6ff1df751fd724d8a316ee2","created_at":"2026-07-25T09:41:29.295Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-695ddaa049b8412f","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.298Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f6ff1df751fd724d8a316ee2: start","job_status":"start","queue_duration_s":0.001805,"scheduling_latency_s":0.001855}2140gitlab # [ 196.463182] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1332141gitlab # [ 196.463899] nixbot[2981]: {"ts": "2026-07-25T09:41:29.309Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291 \"HTTP/1.1 201 Created\""}2142gitlab # [ 196.534251] gitaly[1356]: time="2026-07-25T09:41:29.397Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3902 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:29.397" grpc.time_ms=0.339 pid=1356 span.kind=server system=grpc2143gitlab # [ 196.544496] nix-daemon[3270]: accepted connection from pid 3545, user nixbot2144gitlab # [ 196.574620] gitaly[1356]: time="2026-07-25T09:41:29.438Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3900 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:29.437" grpc.time_ms=0.29 pid=1356 span.kind=server system=grpc2145gitlab # [ 196.600323] gitaly[1356]: time="2026-07-25T09:41:29.463Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3902 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T09:41:29.463" grpc.time_ms=0.351 pid=1356 span.kind=server system=grpc2146gitlab # [ 196.611063] gitaly[1356]: time="2026-07-25T09:41:29.474Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T09:41:59.277" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:29.378" operations="[repack_refs]" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab # [ 196.621572] gitaly[1356]: time="2026-07-25T09:41:29.485Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY diskcache=9fd1a0f5-7ab5-4b69-a0a7-335c0bc0933d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T09:41:59.277" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:29.378" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2148gitlab # [ 196.621913] gitaly[1356]: time="2026-07-25T09:41:29.485Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=78 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7140 command.oublock=0 command.real_time_ms=95 command.spawn_token_fork_ms=0 command.system_time_ms=54 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T09:41:59.277" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:29.378" grpc.time_ms=107.251 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2149gitlab # [ 196.623046] gitaly[1356]: time="2026-07-25T09:41:29.486Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T09:41:59.277" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:29.378" pid=1356 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-07-25 09:41:09.866585398 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2150gitlab # [ 196.652763] gitaly[1356]: time="2026-07-25T09:41:29.516Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCADCQC5MWHKYTCNKE6N6CR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=196 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T09:41:29.502" grpc.time_ms=13.697 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc2151gitlab # [ 196.654073] gitlab-workhorse[1288]: gitlab 2001:db8:1::1 - - [2026/07/25:09:41:29 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 642152gitlab # [ 196.662373] gitaly[1356]: time="2026-07-25T09:41:29.526Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T09:41:59.277" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:29.378" pid=1356 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2153gitlab # [ 196.663211] gitaly[1356]: time="2026-07-25T09:41:29.526Z" level=info msg="optimized repository" clean_stale_data_time=38.927573ms clean_work_trees_time="72.356µs" commit_graph_time="3.352µs" correlation_id=01KYCADCEPP18K6K3F55QFVDVY gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=1356 prune_time="3.352µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.19µs" storage_name=default system=housekeeping total_time=39.111396ms2154gitlab # [ 196.663787] gitaly[1356]: time="2026-07-25T09:41:29.526Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T09:41:59.277" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-25T09:41:29.378" pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 196.664593] gitaly[1356]: time="2026-07-25T09:41:29.528Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T09:41:59.427" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:29.527" grpc.time_ms=0.498 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 196.684030] gitaly[1356]: time="2026-07-25T09:41:29.547Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:59.446" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:29.547" grpc.time_ms=0.369 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab # [ 196.706806] gitaly[1356]: time="2026-07-25T09:41:29.570Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCADCEPP18K6K3F55QFVDVY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:41:59.469" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:29.569" grpc.time_ms=0.414 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2158gitlab # [ 196.714992] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.578Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f6ff1df751fd724d8a316ee2","created_at":"2026-07-25T09:41:29.295Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-695ddaa049b8412f","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.298Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f6ff1df751fd724d8a316ee2: done: 0.277758 sec","job_status":"done","queue_duration_s":0.001805,"scheduling_latency_s":0.001855,"gitaly_calls":4,"gitaly_duration_s":0.117126,"redis_calls":83,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.017284,"redis_read_bytes":173,"redis_write_bytes":20929,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001271,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001522,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_queues_calls":23,"redis_queues_duration_s":0.005402,"redis_queues_read_bytes":25,"redis_queues_write_bytes":13382,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.004887,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000268,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000798,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001865,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":36,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":21,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.113243,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.249596527,"duration_s":0.277758,"completed_at":"2026-07-25T09:41:29.578Z","load_balancing_strategy":"primary","db_duration_s":0.034058,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2159gitlab # [ 196.733509] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.579Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"09b69ca2626a2383d667d02c","created_at":"2026-07-25T09:41:29.371Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.373Z","job_size_bytes":23,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-09b69ca2626a2383d667d02c: start","job_status":"start","queue_duration_s":0.205989,"scheduling_latency_s":0.206005}2160gitlab # [ 196.779858] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.601Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"09b69ca2626a2383d667d02c","created_at":"2026-07-25T09:41:29.371Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.373Z","job_size_bytes":23,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-09b69ca2626a2383d667d02c: done: 0.02188 sec","job_status":"done","queue_duration_s":0.205989,"scheduling_latency_s":0.206005,"redis_calls":7,"redis_duration_s":0.000955,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02188,"completed_at":"2026-07-25T09:41:29.601Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003305,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2161gitlab # [ 196.784563] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.602Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2f932dfdf6ac294de7748909","created_at":"2026-07-25T09:41:29.492Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.494Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2f932dfdf6ac294de7748909: start","job_status":"start","queue_duration_s":0.107394,"scheduling_latency_s":0.107409}2162gitlab # [ 196.799803] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.615Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2f932dfdf6ac294de7748909","created_at":"2026-07-25T09:41:29.492Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.494Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2f932dfdf6ac294de7748909: done: 0.01319 sec","job_status":"done","queue_duration_s":0.107394,"scheduling_latency_s":0.107409,"redis_calls":7,"redis_duration_s":0.000885,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01319,"completed_at":"2026-07-25T09:41:29.615Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001668,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2163gitlab # [ 196.843534] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f4ba7c807ceca5dcf55c94ee","created_at":"2026-07-25T09:41:29.505Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.508Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f4ba7c807ceca5dcf55c94ee: start","job_status":"start","queue_duration_s":0.10764,"scheduling_latency_s":0.107653}2164gitlab # [ 196.884846] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.632Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f4ba7c807ceca5dcf55c94ee","created_at":"2026-07-25T09:41:29.505Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.508Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f4ba7c807ceca5dcf55c94ee: done: 0.016313 sec","job_status":"done","queue_duration_s":0.10764,"scheduling_latency_s":0.107653,"redis_calls":7,"redis_duration_s":0.00096,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016313,"completed_at":"2026-07-25T09:41:29.632Z","load_balancing_strategy":"primary","db_duration_s":0.003212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2165gitlab # [ 196.887229] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.633Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"199634c84eeb84682373bb3d","created_at":"2026-07-25T09:41:29.514Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.516Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-199634c84eeb84682373bb3d: start","job_status":"start","queue_duration_s":0.117225,"scheduling_latency_s":0.117237}2166gitlab # [ 196.935950] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.648Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"199634c84eeb84682373bb3d","created_at":"2026-07-25T09:41:29.514Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.516Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-199634c84eeb84682373bb3d: done: 0.015494 sec","job_status":"done","queue_duration_s":0.117225,"scheduling_latency_s":0.117237,"redis_calls":10,"redis_duration_s":0.001275,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000397,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015494,"completed_at":"2026-07-25T09:41:29.648Z","load_balancing_strategy":"primary","db_duration_s":0.00184,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2167gitlab # [ 196.937429] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.649Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f9ac8762eb4fc7516cff5960","created_at":"2026-07-25T09:41:29.516Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.517Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f9ac8762eb4fc7516cff5960: start","job_status":"start","queue_duration_s":0.131936,"scheduling_latency_s":0.131951}2168gitlab # [ 196.978677] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.662Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f9ac8762eb4fc7516cff5960","created_at":"2026-07-25T09:41:29.516Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.517Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f9ac8762eb4fc7516cff5960: done: 0.012472 sec","job_status":"done","queue_duration_s":0.131936,"scheduling_latency_s":0.131951,"redis_calls":7,"redis_duration_s":0.000916,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000689,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000227,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012472,"completed_at":"2026-07-25T09:41:29.662Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2169gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses2170gitlab # [ 196.987817] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.663Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d31545e7045ff6e8ab3c83df","created_at":"2026-07-25T09:41:29.518Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.519Z","job_size_bytes":19,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d31545e7045ff6e8ab3c83df: start","job_status":"start","queue_duration_s":0.143917,"scheduling_latency_s":0.143931}2171gitlab # [ 197.029979] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.676Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d31545e7045ff6e8ab3c83df","created_at":"2026-07-25T09:41:29.518Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.519Z","job_size_bytes":19,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d31545e7045ff6e8ab3c83df: done: 0.013236 sec","job_status":"done","queue_duration_s":0.143917,"scheduling_latency_s":0.143931,"redis_calls":8,"redis_duration_s":0.001059,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000825,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013236,"completed_at":"2026-07-25T09:41:29.676Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2172gitlab # [ 197.070694] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.677Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"85241f2416f5d0a5539365ec","created_at":"2026-07-25T09:41:29.520Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.521Z","job_size_bytes":66,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-85241f2416f5d0a5539365ec: start","job_status":"start","queue_duration_s":0.155862,"scheduling_latency_s":0.155876}2173gitlab # [ 197.071492] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.688Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"85241f2416f5d0a5539365ec","created_at":"2026-07-25T09:41:29.520Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.521Z","job_size_bytes":66,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-85241f2416f5d0a5539365ec: done: 0.010726 sec","job_status":"done","queue_duration_s":0.155862,"scheduling_latency_s":0.155876,"redis_calls":7,"redis_duration_s":0.0009369999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010726,"completed_at":"2026-07-25T09:41:29.688Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000747,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2174gitlab # [ 197.110680] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.689Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"bf891929cb93b7da17ced5f8","created_at":"2026-07-25T09:41:29.522Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.523Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-bf891929cb93b7da17ced5f8: start","job_status":"start","queue_duration_s":0.165669,"scheduling_latency_s":0.165682}2175gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ef26aec7a6eb23a0fd26815f9e1b8cba9e401291/statuses, in 0.13 seconds)2176(finished: subtest: eval and build post commit statuses, in 10.70 seconds)2177(finished: run the VM test script, in 246.06 seconds)2178gitlab # [ 197.111466] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.705Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"bf891929cb93b7da17ced5f8","created_at":"2026-07-25T09:41:29.522Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.523Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-bf891929cb93b7da17ced5f8: done: 0.016861 sec","job_status":"done","queue_duration_s":0.165669,"scheduling_latency_s":0.165682,"redis_calls":7,"redis_duration_s":0.0008990000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016861,"completed_at":"2026-07-25T09:41:29.705Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001888,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2179gitlab # [ 197.151781] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.706Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"5823d5ae8abfc6bfd0b1e72e","created_at":"2026-07-25T09:41:29.549Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.550Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5823d5ae8abfc6bfd0b1e72e: start","job_status":"start","queue_duration_s":0.155721,"scheduling_latency_s":0.155734}2180gitlab # [ 197.152604] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.720Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"5823d5ae8abfc6bfd0b1e72e","created_at":"2026-07-25T09:41:29.549Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.550Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5823d5ae8abfc6bfd0b1e72e: done: 0.013961 sec","job_status":"done","queue_duration_s":0.155721,"scheduling_latency_s":0.155734,"redis_calls":7,"redis_duration_s":0.00098,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013961,"completed_at":"2026-07-25T09:41:29.720Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002659,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2181gitlab # [ 197.221883] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.721Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b4dce3168c44d9713c1412ef","created_at":"2026-07-25T09:41:29.551Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.552Z","job_size_bytes":6,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b4dce3168c44d9713c1412ef: start","job_status":"start","queue_duration_s":0.168908,"scheduling_latency_s":0.168921}2182gitlab # [ 197.222709] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.729Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b4dce3168c44d9713c1412ef","created_at":"2026-07-25T09:41:29.551Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.552Z","job_size_bytes":6,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b4dce3168c44d9713c1412ef: done: 0.008354 sec","job_status":"done","queue_duration_s":0.168908,"scheduling_latency_s":0.168921,"redis_calls":7,"redis_duration_s":0.001054,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000811,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008354,"completed_at":"2026-07-25T09:41:29.729Z","load_balancing_strategy":"primary","db_duration_s":0.000232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2183gitlab # [ 197.252695] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.730Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"fa5417665e698871649a0c80","created_at":"2026-07-25T09:41:29.552Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.553Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-fa5417665e698871649a0c80: start","job_status":"start","queue_duration_s":0.176781,"scheduling_latency_s":0.176794}2184gitlab # [ 197.265821] sidekiq-cluster[2048]: {"severity":"INFO","time":"2026-07-25T09:41:29.741Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"fa5417665e698871649a0c80","created_at":"2026-07-25T09:41:29.552Z","trace_propagation_headers":{"sentry-trace":"d2b10003c8e245f59a3f9efcd522cb6f-5f6dfcb9ef9947f2","baggage":"sentry-trace_id=d2b10003c8e245f59a3f9efcd522cb6f,sentry-release=Unknown"},"correlation_id":"01KYCADCEPP18K6K3F55QFVDVY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-07-25T09:41:29.553Z","job_size_bytes":3,"pid":2048,"sidekiq_tid":"ma38","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-fa5417665e698871649a0c80: done: 0.010904 sec","job_status":"done","queue_duration_s":0.176781,"scheduling_latency_s":0.176794,"redis_calls":7,"redis_duration_s":0.000907,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010904,"completed_at":"2026-07-25T09:41:29.741Z","load_balancing_strategy":"primary","db_duration_s":0.001191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2185test script finished in 246.25s2186cleanup2187kill QemuMachine (pid 13)2188gitlab # [ 197.313554] gitaly[1356]: time="2026-07-25T09:41:30.001Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYCADD7N082J8JWT9FF2SBP4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T09:42:00.100" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T09:41:30.001" grpc.time_ms=0.429 pid=1356 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2189gitlab # [ 197.314188] gitaly[1356]: time="2026-07-25T09:41:30.083Zqemu-system-x86_64: terminating on signal 15 from pid 6 (/nix/store/60m4rxhg2fldqaak400c0lry96ijrzqn-python3-3.13.13/bin/python3.13)2190(finished: cleanup, in 1.56 seconds)2191additionally exposed symbols:2192 gitlab,2193 vlan1,2194 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2195[]2196[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-07-25T09:41:15.626Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2197[]2198[]2199[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-07-25T09:41:19.267394Z', 'started_at': None, 'finished_at': None}]2200[]2201[{'id': 2, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-25T09:41:19.650Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2202[{'id': 2, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-25T09:41:19.650Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2203[{'id': 2, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-25T09:41:19.650Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2204[{'id': 2, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-25T09:41:19.650Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2205[{'id': 2, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-25T09:41:19.650Z', 'started_at': None, 'finished_at': '2026-07-25T09:41:24.657Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-25T09:41:24.763Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2206[{'id': 2, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-25T09:41:19.650Z', 'started_at': None, 'finished_at': '2026-07-25T09:41:24.657Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-25T09:41:24.763Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2207[{'id': 2, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-25T09:41:19.650Z', 'started_at': None, 'finished_at': '2026-07-25T09:41:24.657Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-25T09:41:24.763Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2208[{'id': 2, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-25T09:41:19.650Z', 'started_at': None, 'finished_at': '2026-07-25T09:41:24.657Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-25T09:41:24.763Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2209[{'id': 2, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-25T09:41:19.650Z', 'started_at': None, 'finished_at': '2026-07-25T09:41:24.657Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'ef26aec7a6eb23a0fd26815f9e1b8cba9e401291', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-07-25T09:41:24.763Z', 'started_at': None, 'finished_at': '2026-07-25T09:41:29.287Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]